-- Logs begin at Fri 2022-08-19 02:50:08 UTC, end at Fri 2022-08-19 04:16:54 UTC. -- Aug 19 03:49:51.621154 dv-osbrick-786733-7-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 19 03:49:51.630447 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 19 03:49:51.632449 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 19 03:49:51 2022] *** Aug 19 03:49:51.632449 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 19 03:49:51.632449 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 19 03:49:51.632449 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: nodename: dv-osbrick-786733-7-ceph Aug 19 03:49:51.632449 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: machine: x86_64 Aug 19 03:49:51.632449 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: clock source: unix Aug 19 03:49:51.632449 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: pcre jit disabled Aug 19 03:49:51.632449 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: detected number of CPU cores: 4 Aug 19 03:49:51.632449 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: current working directory: / Aug 19 03:49:51.632449 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: detected binary path: /usr/bin/uwsgi-core Aug 19 03:49:51.632449 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: your processes number limit is 47680 Aug 19 03:49:51.633761 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: your memory page size is 4096 bytes Aug 19 03:49:51.633761 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: detected max file descriptor number: 2048 Aug 19 03:49:51.633761 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: lock engine: pthread robust mutexes Aug 19 03:49:51.633761 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: thunder lock: enabled Aug 19 03:49:51.633761 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 19 03:49:51.633761 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 19 03:49:51.676802 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: Python main interpreter initialized at 0x55aadc05b9c0 Aug 19 03:49:51.676802 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: python threads support enabled Aug 19 03:49:51.676802 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: your server socket listen backlog is limited to 100 connections Aug 19 03:49:51.676802 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: your mercy for graceful operations on workers is 90 seconds Aug 19 03:49:51.677135 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: mapped 403077 bytes (393 KB) for 2 cores Aug 19 03:49:51.677205 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: *** Operational MODE: preforking *** Aug 19 03:49:51.677463 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: *** uWSGI is running in multiple interpreter mode *** Aug 19 03:49:51.677463 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: spawned uWSGI master process (pid: 88186) Aug 19 03:49:51.677651 dv-osbrick-786733-7-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 19 03:49:51.678464 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: spawned uWSGI worker 1 (pid: 88197, cores: 1) Aug 19 03:49:51.678556 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: spawned uWSGI worker 2 (pid: 88198, cores: 1) Aug 19 03:49:51.680946 dv-osbrick-786733-7-ceph devstack@keystone.service[88186]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 19 03:49:56.255032 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 03:49:56.255032 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: from cryptography.utils import int_from_bytes Aug 19 03:49:56.255791 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 03:49:56.255791 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: from cryptography.utils import int_from_bytes Aug 19 03:49:56.256223 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 03:49:56.256223 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: from cryptography.utils import int_from_bytes Aug 19 03:49:56.256365 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 03:49:56.256365 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: from cryptography.utils import int_from_bytes Aug 19 03:49:56.306501 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 03:49:56.306711 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 03:49:56.306900 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] command line args: [] {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 03:49:56.307178 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 03:49:56.307352 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ================================================================================ {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 03:49:56.307605 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] admin_token = **** {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.307690 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 03:49:56.307851 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] config_dir = [] {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.307961 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 03:49:56.308052 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.308205 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] config_source = [] {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.308289 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] command line args: [] {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 03:49:56.308368 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] debug = True {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.308609 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.308868 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 03:49:56.308868 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ================================================================================ {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 03:49:56.308991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.309050 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] admin_token = **** {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.309147 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.309273 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] config_dir = [] {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.309401 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.309477 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.309629 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] config_source = [] {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.309720 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.309879 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] debug = True {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.309965 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] list_limit = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.310031 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] log_config_append = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.310187 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.310286 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.310354 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] log_dir = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.310548 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.310665 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] log_file = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.310772 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.310870 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.311008 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.311118 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.311235 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.311332 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.311469 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.311554 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] list_limit = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.311678 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.311761 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] log_config_append = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.311836 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.311914 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.312040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.312119 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] log_dir = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.312286 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.312373 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] log_file = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.312544 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.312685 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.312784 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.313019 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.313094 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.313252 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.313383 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.313498 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.313578 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.313711 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.313789 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.313893 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.314006 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.314140 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.314395 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.314503 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.314638 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.314725 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] publish_errors = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.314849 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.314926 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.315074 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.315163 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.315285 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.315362 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.315532 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.315658 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.315767 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.315858 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.316003 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] standard_threads = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.316087 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.316235 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.316501 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.316591 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.316689 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.316767 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] publish_errors = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.316849 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] use_journal = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.316917 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.317009 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] use_json = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.317152 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.317230 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] use_stderr = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.317332 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.317460 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] use_syslog = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.317564 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.317640 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.317804 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.317881 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.318043 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] standard_threads = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.318276 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.318518 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.318607 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.318681 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.318787 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.318866 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] use_journal = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.319021 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] use_json = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.319099 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.319197 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] use_stderr = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.319282 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.319398 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] use_syslog = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.319524 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.319639 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 03:49:56.319777 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.319882 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.320015 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.320127 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.320265 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.320379 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.320533 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.320628 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.320785 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.320865 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.321021 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.321111 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.321271 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.321357 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.321508 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.321593 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.321755 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.321845 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.322004 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.322088 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.322241 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.322324 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.322477 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.322564 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.322728 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.322808 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.322968 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.323048 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.323201 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.323356 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.323437 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.323509 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.323679 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.323763 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.323937 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.324027 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.324184 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.324263 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.324417 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.324532 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.324673 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.324754 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.324903 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.324988 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.325138 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.325223 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.325385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.325465 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.325632 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.325709 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.325861 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.325940 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.326092 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.326176 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.326326 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.326405 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.326566 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.326645 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.326807 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.326886 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.327058 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.327179 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.327289 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.327380 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.327519 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.327598 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.327752 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.327829 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.327983 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.328067 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.328214 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.328316 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.328445 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.328573 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.328702 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.328780 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.328931 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.329012 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.329158 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.329237 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.329390 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.329475 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.329623 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.329703 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.329852 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.329929 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.330079 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.330162 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.330312 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.330390 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.330558 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.330642 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.330787 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.330865 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.331023 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.331102 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.331256 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.331334 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.331488 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.331566 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.331724 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.331809 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.331957 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.332033 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.332186 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.332299 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.332424 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.332552 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.332685 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.332764 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.332920 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.333010 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.333148 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.333232 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.333382 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.333461 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.333616 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.333695 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.333847 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.333938 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.334084 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.334172 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.334319 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.334404 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.334550 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.334640 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.334808 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.334887 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.335070 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.335148 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.335307 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.335394 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.335541 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.335620 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.335776 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.335859 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.336011 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.336099 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.336260 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.336344 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.336514 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.336599 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.336762 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.336854 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.336999 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.337078 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.337233 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.337312 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.337468 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.337554 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.337700 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.337779 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.337937 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.338016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.338170 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.338257 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.338411 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.338490 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.338650 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.338729 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.338887 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.338973 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.339122 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.339201 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.339360 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.339478 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.339598 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.339722 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.339833 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.339987 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.340065 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.340232 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.340311 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.340493 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.340578 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.340740 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.340821 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.340976 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.341055 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.341207 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.341296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.341445 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.341524 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.341677 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.341755 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.341911 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.342000 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.342146 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.342227 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.342383 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.342462 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.342625 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.342712 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.342861 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.342941 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.343089 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] auth.external = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.343167 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.343319 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.343407 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.343569 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.343647 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.343810 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.343890 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.344052 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] auth.password = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.344139 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.344283 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] auth.token = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.344363 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.344544 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.344646 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.344785 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.344867 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] auth.external = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.345016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.345145 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.345316 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.345397 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.345553 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.345692 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.345775 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] auth.password = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.345846 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.346008 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] auth.token = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.346089 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.346250 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.346332 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] credential.caching = True {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.346491 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.346584 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.346742 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.346823 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.346976 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.347057 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.347229 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.347318 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.347471 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.347549 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.347700 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.347780 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.347940 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] credential.caching = True {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.348028 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.348190 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.348270 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.348430 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.348524 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.348703 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.348798 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.348943 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.349024 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.349189 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.349275 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.349426 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.349515 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.349693 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.349773 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.349947 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.350026 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.350184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.350271 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] federation.caching = True {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.350423 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.350503 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.351188 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.351273 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.351439 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.351530 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.351673 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.351753 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.351923 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.352004 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.352163 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.352255 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.352411 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] federation.caching = True {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.352529 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.352673 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.352755 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.352920 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.353008 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.353157 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.353236 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.353389 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.353468 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.353632 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] identity.caching = True {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.353713 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.353872 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.353958 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.354117 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.354196 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.354354 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.354435 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.354590 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.354672 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.354836 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.354917 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.355067 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.355144 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.355295 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.355388 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] identity.caching = True {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.355545 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.355625 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.355792 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.355873 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.356024 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.356105 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.356255 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.356335 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.356503 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.356588 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.356740 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.356819 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.356982 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.357063 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.357233 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.357315 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.357483 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.357568 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.357717 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.357798 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.357951 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.358034 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.358185 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.358272 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.358431 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.358510 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.358664 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.358746 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.358901 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.358982 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.359130 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.359211 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.359366 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.359447 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.359605 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.359685 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.359845 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.359926 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.360092 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.360173 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.360320 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.360400 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.360579 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.360662 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.360815 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.360898 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.361048 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.361127 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.361300 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.361382 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.361529 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.361616 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.361758 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.361839 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.361995 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.362074 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.362221 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.362302 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.362458 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.362538 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.362693 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.362776 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.362932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.363014 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.363168 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.363248 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.363396 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.363488 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.363638 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.363726 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.363871 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.363956 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.364098 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.364185 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.364327 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.364407 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.364589 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.364673 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.364834 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.364925 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.365071 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.365151 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.365302 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.365381 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.365539 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.365628 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.365770 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.user = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.365851 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.366001 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.366080 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.366327 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.366916 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.367066 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.367147 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.367315 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.367396 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.367551 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.367638 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.367791 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.367872 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.368024 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.user = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.368104 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.368251 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.368339 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.368498 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.368592 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.368746 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.368836 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.368982 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.369074 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.369213 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.369295 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.369459 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.369540 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.369694 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.369781 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.369928 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.370014 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.370166 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.370246 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.370404 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.370492 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.370632 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.370711 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.370860 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.370940 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.371100 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.371192 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.371336 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.371418 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.371571 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.371653 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.371806 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.371894 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.372051 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.372130 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.372283 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.372363 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.372538 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.372634 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.372781 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.372861 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.373011 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.373090 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.373246 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.373333 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.373482 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.373563 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.373715 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.373794 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.373937 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.374030 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.374185 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.374265 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.374424 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.374505 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.374653 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.374741 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.374884 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.374963 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.375123 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] resource.caching = True {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.375204 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.375358 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.375446 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.375598 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.375678 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.375829 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.375907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.376074 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.376162 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.376307 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.376387 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.376564 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.376647 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.376807 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] resource.caching = True {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.376898 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.377044 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.377176 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.377284 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.377364 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.377519 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.377606 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] role.caching = True {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.377761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] role.driver = sql {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.377840 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.377992 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.378072 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.378234 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.378389 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.378466 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.378539 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.378711 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.378791 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.378953 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.379035 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.379192 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] role.caching = True {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.379273 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.379434 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.379513 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] role.driver = sql {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.379664 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.379744 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.379911 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.379990 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.380143 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.380288 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.380376 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.380451 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.380649 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.380731 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.380894 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.380974 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.381138 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.381219 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.381385 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.381542 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.381623 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.381804 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.381897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.382059 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.382141 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.382310 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.382390 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.382560 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.382648 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.382812 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.382894 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.383048 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.383206 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.383286 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.383446 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.383528 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.383700 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.383781 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.383954 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.384046 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.384197 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.384276 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.384427 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.384555 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.384699 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.384791 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.384952 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.385032 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.385202 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.385281 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.385437 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.385524 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.385669 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.385749 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.385898 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.385976 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.386129 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.386216 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] token.caching = True {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.386364 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.386442 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.386610 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.386690 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.386847 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.386935 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.387086 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.387166 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.387325 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.387406 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.387559 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.387647 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.387797 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] token.caching = True {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.387878 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.388035 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.388116 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.388282 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.388368 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.388541 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.388652 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.388809 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.388902 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.389054 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.389161 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.389294 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.389389 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.389541 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.389622 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.389786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.389875 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.390034 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.390114 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.390273 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.390355 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.390515 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.390603 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] database.connection = **** {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.390755 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.390844 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.391008 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.391107 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.391258 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.391340 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.391488 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.391569 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.391723 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.391802 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.391960 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.392041 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.392195 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.392277 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] database.connection = **** {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.392430 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.392539 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.392712 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.392800 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.392949 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.393030 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.393194 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.393277 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.393429 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.393508 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.393669 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.393753 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.393903 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.393985 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.394137 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.394216 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.394365 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.394445 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.394603 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.394684 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.394838 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.394918 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.394992 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 03:49:56.395066 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.395311 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.395548 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.395792 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.396026 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.396268 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.396519 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 03:49:56.396693 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 03:49:56.424424 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.424621 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.424846 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.425503 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.425739 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.425967 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.433858 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.435080 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.462504 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.462707 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.462789 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.462896 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.514252 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.514856 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.562778 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.563007 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.564258 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.564506 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.627979 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.628202 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.628309 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.628422 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.628545 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.628666 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.628752 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.628882 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.628969 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.629100 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.629185 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.629350 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.652204 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.652433 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.652688 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.652913 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.652997 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.653131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.653216 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.653343 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.653428 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.653553 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.653636 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.653825 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.654043 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.654259 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.665380 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.665683 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.677799 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.677986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.678209 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.678292 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.678429 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.678561 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.678675 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.678758 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.678888 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.678971 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.679099 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.679192 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.679310 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.679524 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 03:49:56.695733 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.695938 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 03:49:56.696038 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.696225 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 03:49:56.696308 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.696460 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 03:49:56.696597 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.696761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.696847 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 03:49:56.697023 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.697107 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.697279 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.697361 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.697534 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.697618 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.697786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.706899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.707173 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.707259 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.707444 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.707529 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.707711 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.707795 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.707994 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.715196 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.715477 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.718058 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.718339 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.718422 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.718617 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.718700 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.718894 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.718977 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.719174 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.719266 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.719428 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.719550 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.719692 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.719774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.719958 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.720047 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.720223 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.720302 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.720498 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.720580 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.720777 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.720858 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.721040 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.744045 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.745262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.745539 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.745822 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.746719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.746999 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.750333 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.750617 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.750897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.751503 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.751784 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.752176 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.758561 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.758848 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.758930 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.759170 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.762831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.763120 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.763202 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.763402 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.763485 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.763700 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.763805 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.763995 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.764084 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.764353 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.764434 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.764649 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.764797 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.764938 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.765069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.765196 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.780778 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.781054 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.781294 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.781572 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.784894 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.785680 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.788831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.789241 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.789382 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.789650 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.793455 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.793979 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.796561 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.797108 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.799613 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.799910 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.800197 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.800283 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.800518 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.800606 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.800814 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.800900 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.801160 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.801256 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.801474 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.801763 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.816765 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.817053 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.817320 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.817562 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.817647 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.817851 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.818117 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.818377 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.824228 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.825111 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.826085 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.826362 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.826769 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.827050 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.829008 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.829293 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.829583 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.829733 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.829871 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.830019 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.830155 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.830315 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.830608 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.830899 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.841767 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.842044 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.842322 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.842598 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.842681 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.842878 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.842966 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.843149 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.843234 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.843422 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.843508 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.843793 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.844084 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.844365 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.859184 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.860224 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.862276 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.863584 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.865275 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.866740 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.866849 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.868174 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.868269 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.868461 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.868767 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.869660 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.869949 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.870237 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.875165 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.876663 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.876762 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.878112 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.879491 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.879780 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.880062 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.880363 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.881119 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.881421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.881732 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.882019 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.889180 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.889471 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.889751 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.889933 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.890225 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.890506 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.896900 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.897231 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 03:49:56.897805 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.898084 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.898372 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.898641 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.898912 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.899192 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.899375 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.899458 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.899673 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.899764 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.899960 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.900043 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.900234 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.900315 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.900513 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.900612 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.900790 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.900871 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.901044 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.901174 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.901335 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.901604 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.901876 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.902145 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.902417 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.902676 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 03:49:56.934314 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55aadc05b9c0 pid: 88197 (default app) Aug 19 03:49:56.936795 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55aadc05b9c0 pid: 88198 (default app) Aug 19 03:49:56.937715 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd605e6-6c3f-4e37-96bb-09c49db4c5cc None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:49:56.938003 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd605e6-6c3f-4e37-96bb-09c49db4c5cc None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:49:56.938276 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd605e6-6c3f-4e37-96bb-09c49db4c5cc None None] PATH_INFO: `/v3` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:49:56.942472 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Fri Aug 19 03:49:56 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:03.911182 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1d5fc-b548-43b3-8169-47f68725ff46 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:03.911727 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1d5fc-b548-43b3-8169-47f68725ff46 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:03.911727 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1d5fc-b548-43b3-8169-47f68725ff46 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:03.916137 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:03.921167 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cf117-8ee3-4dee-b0cb-0b29233d57ca None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:03.921565 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cf117-8ee3-4dee-b0cb-0b29233d57ca None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:03.921716 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cf117-8ee3-4dee-b0cb-0b29233d57ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:03.996914 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: INFO dbcounter [None req-726cf117-8ee3-4dee-b0cb-0b29233d57ca None None] Registered counter for database keystone Aug 19 03:50:04.016509 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG oslo_db.sqlalchemy.engines [None req-726cf117-8ee3-4dee-b0cb-0b29233d57ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 03:50:04.023298 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writer thread running {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 03:50:04.209202 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG passlib.handlers.bcrypt [None req-726cf117-8ee3-4dee-b0cb-0b29233d57ca None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88197) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 19 03:50:04.209617 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG passlib.handlers.bcrypt [None req-726cf117-8ee3-4dee-b0cb-0b29233d57ca None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88197) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 19 03:50:04.269464 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-726cf117-8ee3-4dee-b0cb-0b29233d57ca None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:04.271099 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-726cf117-8ee3-4dee-b0cb-0b29233d57ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:04.398035 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 478 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 19 03:50:04.920808 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1d5fc-b548-43b3-8169-47f68725ff46 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:05.001668 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: INFO dbcounter [None req-f4e1d5fc-b548-43b3-8169-47f68725ff46 None None] Registered counter for database keystone Aug 19 03:50:05.024712 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG oslo_db.sqlalchemy.engines [None req-f4e1d5fc-b548-43b3-8169-47f68725ff46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 03:50:05.030888 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writer thread running {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 03:50:05.151226 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1d5fc-b548-43b3-8169-47f68725ff46 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:05.155530 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166495f-183a-47ed-aecf-b2c25e208d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:05.156156 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166495f-183a-47ed-aecf-b2c25e208d96 admin admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:05.156439 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166495f-183a-47ed-aecf-b2c25e208d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:05.156744 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166495f-183a-47ed-aecf-b2c25e208d96 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:05.166048 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166495f-183a-47ed-aecf-b2c25e208d96 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:05.216452 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5166495f-183a-47ed-aecf-b2c25e208d96 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 19 03:50:05.216818 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166495f-183a-47ed-aecf-b2c25e208d96 admin admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:05.226983 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Aug 19 03:50:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 03:50:05.232813 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cf117-8ee3-4dee-b0cb-0b29233d57ca None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:05.249506 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cf117-8ee3-4dee-b0cb-0b29233d57ca None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:05.253978 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0258169-7f01-44a2-9e22-93f9e0675f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:05.255570 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0258169-7f01-44a2-9e22-93f9e0675f71 admin admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:05.255855 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0258169-7f01-44a2-9e22-93f9e0675f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:05.256128 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0258169-7f01-44a2-9e22-93f9e0675f71 admin admin] PATH_INFO: `/v3/projects/55a24eb901d34f7180f97d4cbef6abef` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:05.257612 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0258169-7f01-44a2-9e22-93f9e0675f71 admin admin] RBAC: Authorizing `identity:get_project(project_id=55a24eb901d34f7180f97d4cbef6abef)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:05.307799 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e0258169-7f01-44a2-9e22-93f9e0675f71 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 19 03:50:05.308155 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0258169-7f01-44a2-9e22-93f9e0675f71 admin admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:05.312807 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 3/5] 10.222.0.43 () {56 vars in 1207 bytes} [Fri Aug 19 03:50:05 2022] GET /identity/v3/projects/55a24eb901d34f7180f97d4cbef6abef => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:07.433234 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9137ce-fb11-42a1-91e4-0716689f01d3 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:07.433730 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9137ce-fb11-42a1-91e4-0716689f01d3 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:07.433730 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9137ce-fb11-42a1-91e4-0716689f01d3 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:07.437843 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 3/6] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:07.443121 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b370b-bced-4abd-8034-e2f9e3b80dcb None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:07.443535 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b370b-bced-4abd-8034-e2f9e3b80dcb None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:07.443681 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b370b-bced-4abd-8034-e2f9e3b80dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:07.463744 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-280b370b-bced-4abd-8034-e2f9e3b80dcb None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:07.465318 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-280b370b-bced-4abd-8034-e2f9e3b80dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:07.473811 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 19 03:50:07.796155 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9137ce-fb11-42a1-91e4-0716689f01d3 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:07.808787 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9137ce-fb11-42a1-91e4-0716689f01d3 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:07.812993 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc455628-a7e4-4ea3-8fe6-843a58f058b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:07.813587 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc455628-a7e4-4ea3-8fe6-843a58f058b8 admin admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:07.813867 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc455628-a7e4-4ea3-8fe6-843a58f058b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:07.814141 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc455628-a7e4-4ea3-8fe6-843a58f058b8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:07.821804 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc455628-a7e4-4ea3-8fe6-843a58f058b8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:07.823589 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc455628-a7e4-4ea3-8fe6-843a58f058b8 admin admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:07.832220 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1324 bytes} [Fri Aug 19 03:50:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 03:50:07.837460 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b370b-bced-4abd-8034-e2f9e3b80dcb None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:07.846517 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b370b-bced-4abd-8034-e2f9e3b80dcb None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:07.851418 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafda081-ba39-4a82-9f34-82d97af3a3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:07.852041 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafda081-ba39-4a82-9f34-82d97af3a3c6 admin admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:07.852324 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafda081-ba39-4a82-9f34-82d97af3a3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:07.852647 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafda081-ba39-4a82-9f34-82d97af3a3c6 admin admin] PATH_INFO: `/v3/users/3297fc4b647c4c1aa4dde010a58c50d8` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:07.853960 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafda081-ba39-4a82-9f34-82d97af3a3c6 admin admin] RBAC: Authorizing `identity:get_user(user_id=3297fc4b647c4c1aa4dde010a58c50d8)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:07.855815 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafda081-ba39-4a82-9f34-82d97af3a3c6 admin admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:07.857363 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 5/9] 10.222.0.43 () {56 vars in 1198 bytes} [Fri Aug 19 03:50:07 2022] GET /identity/v3/users/3297fc4b647c4c1aa4dde010a58c50d8 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:10.055042 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cd622-7538-41c6-8ebe-473b814a4212 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:10.055562 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cd622-7538-41c6-8ebe-473b814a4212 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:10.055667 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cd622-7538-41c6-8ebe-473b814a4212 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:10.056960 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:10.062025 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a05c16-0499-4b43-9a96-43eaf863a817 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:10.062440 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a05c16-0499-4b43-9a96-43eaf863a817 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:10.062643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a05c16-0499-4b43-9a96-43eaf863a817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:10.081028 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-d8a05c16-0499-4b43-9a96-43eaf863a817 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:10.082772 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-d8a05c16-0499-4b43-9a96-43eaf863a817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:10.085141 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9238c6c-65aa-48a9-96e6-1a8083ef342b None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:10.085437 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9238c6c-65aa-48a9-96e6-1a8083ef342b None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:10.085718 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9238c6c-65aa-48a9-96e6-1a8083ef342b None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:10.087030 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 6/11] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 03:50:10.092019 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721bae0-08cb-4da9-8ea3-77337e8bb3e8 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:10.092308 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721bae0-08cb-4da9-8ea3-77337e8bb3e8 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:10.092630 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721bae0-08cb-4da9-8ea3-77337e8bb3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:10.134424 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG passlib.handlers.bcrypt [None req-c721bae0-08cb-4da9-8ea3-77337e8bb3e8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88198) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 19 03:50:10.134864 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG passlib.handlers.bcrypt [None req-c721bae0-08cb-4da9-8ea3-77337e8bb3e8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88198) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 19 03:50:10.181688 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-c721bae0-08cb-4da9-8ea3-77337e8bb3e8 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:10.183354 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-c721bae0-08cb-4da9-8ea3-77337e8bb3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:10.274839 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:10.294633 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 03:50:10.592548 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a05c16-0499-4b43-9a96-43eaf863a817 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:10.614419 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721bae0-08cb-4da9-8ea3-77337e8bb3e8 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:10.617730 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:10.698024 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a05c16-0499-4b43-9a96-43eaf863a817 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:10.714920 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721bae0-08cb-4da9-8ea3-77337e8bb3e8 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:10.717263 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:10.732336 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12240a2-5412-4d9b-b501-a5f59f5d7955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:10.733241 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12240a2-5412-4d9b-b501-a5f59f5d7955 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:10.733523 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12240a2-5412-4d9b-b501-a5f59f5d7955 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:10.733799 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12240a2-5412-4d9b-b501-a5f59f5d7955 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:10.745265 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12240a2-5412-4d9b-b501-a5f59f5d7955 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:10.754079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-f12240a2-5412-4d9b-b501-a5f59f5d7955 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:50:10.754079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:10.754079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:10.754079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:10.754079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:10.754079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:10.754079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:10.754079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:10.754079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:10.754079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:10.754079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:10.754079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:10.754079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:10.754079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:10.754079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:10.754079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:10.755115 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:10.755115 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:10.755115 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:10.755115 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:10.755115 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:10.755115 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:10.755115 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:10.755115 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:10.755115 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:10.755115 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:10.755115 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:10.755115 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:10.755115 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:10.755115 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:10.755115 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:10.755115 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:10.756093 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:10.756093 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:10.756093 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:10.756093 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:10.756093 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:10.756093 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:10.756093 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:10.756093 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:10.756093 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:10.756093 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:10.756093 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:50:10.756093 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:50:10.756889 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe001c18-e086-4236-a9e5-af93c46b3123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:10.756889 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe001c18-e086-4236-a9e5-af93c46b3123 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:10.756889 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe001c18-e086-4236-a9e5-af93c46b3123 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:10.757126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 7/14] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 03:50:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:50:10.757208 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe001c18-e086-4236-a9e5-af93c46b3123 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:10.763037 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12240a2-5412-4d9b-b501-a5f59f5d7955 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:10.824182 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe001c18-e086-4236-a9e5-af93c46b3123 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:10.825738 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe001c18-e086-4236-a9e5-af93c46b3123 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:10.844718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:10.863879 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12240a2-5412-4d9b-b501-a5f59f5d7955 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:10.897973 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa75cd-214f-4241-9a4e-dc39d6c6ac06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:10.898627 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa75cd-214f-4241-9a4e-dc39d6c6ac06 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:10.898910 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa75cd-214f-4241-9a4e-dc39d6c6ac06 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:10.899184 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa75cd-214f-4241-9a4e-dc39d6c6ac06 None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:10.899843 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa75cd-214f-4241-9a4e-dc39d6c6ac06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:10.900141 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa75cd-214f-4241-9a4e-dc39d6c6ac06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:10.901554 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa75cd-214f-4241-9a4e-dc39d6c6ac06 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:10.914234 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 8/15] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:50:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:50:10.919590 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa75cd-214f-4241-9a4e-dc39d6c6ac06 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:10.923943 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 8/16] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:50:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 03:50:10.929151 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe001c18-e086-4236-a9e5-af93c46b3123 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:10.931853 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:11.016649 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa75cd-214f-4241-9a4e-dc39d6c6ac06 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:11.025830 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe001c18-e086-4236-a9e5-af93c46b3123 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:11.057389 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241f2fc-03b3-4a9e-8219-4ae4ee699fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:11.058024 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241f2fc-03b3-4a9e-8219-4ae4ee699fc2 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:11.058310 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241f2fc-03b3-4a9e-8219-4ae4ee699fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:11.058584 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241f2fc-03b3-4a9e-8219-4ae4ee699fc2 None admin] PATH_INFO: `/v3/users/3297fc4b647c4c1aa4dde010a58c50d8` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:11.059705 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241f2fc-03b3-4a9e-8219-4ae4ee699fc2 None admin] RBAC: Authorizing `identity:get_user(user_id=3297fc4b647c4c1aa4dde010a58c50d8)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:11.061200 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241f2fc-03b3-4a9e-8219-4ae4ee699fc2 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:11.061492 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2677f-2a14-4bad-9105-3ea893f250d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:11.062350 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2677f-2a14-4bad-9105-3ea893f250d3 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:11.062636 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2677f-2a14-4bad-9105-3ea893f250d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:11.062786 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 9/17] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:10 2022] GET /identity/v3/users/3297fc4b647c4c1aa4dde010a58c50d8 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:50:11.063146 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2677f-2a14-4bad-9105-3ea893f250d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:11.068180 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241f2fc-03b3-4a9e-8219-4ae4ee699fc2 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:11.081349 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2677f-2a14-4bad-9105-3ea893f250d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:11.082734 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:11.083603 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2677f-2a14-4bad-9105-3ea893f250d3 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:11.102421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-c0b2677f-2a14-4bad-9105-3ea893f250d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:50:11.102421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:11.102421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:11.102421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:11.102421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:11.102421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:11.102421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:11.102421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:11.102421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:11.102421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:11.102421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:11.102421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:11.102421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:50:11.102421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:50:11.102421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:50:11.102421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:50:11.103302 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:11.103302 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:11.103302 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:11.103302 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:11.103302 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:11.103302 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:11.103302 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:11.103302 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:11.103302 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:11.103302 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:11.103302 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:11.103302 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:11.103302 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:11.103302 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:11.103302 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:11.103302 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:11.103302 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:50:11.104276 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:50:11.104276 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:50:11.104276 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:50:11.104276 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 9/18] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 03:50:11.109126 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2677f-2a14-4bad-9105-3ea893f250d3 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:11.165799 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:11.168766 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241f2fc-03b3-4a9e-8219-4ae4ee699fc2 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:11.204135 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1a6ac-e2a2-4d26-b8f5-116116e23f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:11.204831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1a6ac-e2a2-4d26-b8f5-116116e23f8f None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:11.205113 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1a6ac-e2a2-4d26-b8f5-116116e23f8f None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:11.205390 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1a6ac-e2a2-4d26-b8f5-116116e23f8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:11.207129 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1a6ac-e2a2-4d26-b8f5-116116e23f8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:11.208647 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1a6ac-e2a2-4d26-b8f5-116116e23f8f None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:11.210279 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 10/19] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:50:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:50:11.216370 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1a6ac-e2a2-4d26-b8f5-116116e23f8f None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:11.300717 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:11.319703 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2677f-2a14-4bad-9105-3ea893f250d3 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:11.323162 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1a6ac-e2a2-4d26-b8f5-116116e23f8f None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:11.353948 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798b010-835a-4e29-b14a-57d591bb209b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:11.354548 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798b010-835a-4e29-b14a-57d591bb209b None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:11.354855 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798b010-835a-4e29-b14a-57d591bb209b None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:11.355126 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798b010-835a-4e29-b14a-57d591bb209b None admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:11.355758 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798b010-835a-4e29-b14a-57d591bb209b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:11.356057 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798b010-835a-4e29-b14a-57d591bb209b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:11.357196 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbc24f-8cb9-4779-b40e-f965ed64cac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:11.357493 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798b010-835a-4e29-b14a-57d591bb209b None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:11.357799 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbc24f-8cb9-4779-b40e-f965ed64cac8 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:11.358079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbc24f-8cb9-4779-b40e-f965ed64cac8 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:11.358354 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbc24f-8cb9-4779-b40e-f965ed64cac8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:11.359075 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbc24f-8cb9-4779-b40e-f965ed64cac8 None admin] RBAC: Adding query filter params (role.id=e154509f216e4ae59f74044aa234ddde, scope.domain.id=default, user.id=3297fc4b647c4c1aa4dde010a58c50d8) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:11.359384 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbc24f-8cb9-4779-b40e-f965ed64cac8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:11.360838 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbc24f-8cb9-4779-b40e-f965ed64cac8 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:11.367894 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 11/20] 10.222.0.43 () {56 vars in 1322 bytes} [Fri Aug 19 03:50:11 2022] GET /identity/v3/role_assignments?user.id=3297fc4b647c4c1aa4dde010a58c50d8&scope.domain.id=default&role.id=e154509f216e4ae59f74044aa234ddde => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:50:11.374917 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 10/21] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:50:13.910434 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dc3a4-4f91-4d88-93a0-eae42bc89836 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:13.911477 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dc3a4-4f91-4d88-93a0-eae42bc89836 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:13.911963 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dc3a4-4f91-4d88-93a0-eae42bc89836 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:13.913573 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 12/22] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:13.919481 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4d9b3-3099-4b88-961b-035836828a01 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:13.920411 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4d9b3-3099-4b88-961b-035836828a01 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:13.920963 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4d9b3-3099-4b88-961b-035836828a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:13.944036 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-76c4d9b3-3099-4b88-961b-035836828a01 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:13.949604 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-76c4d9b3-3099-4b88-961b-035836828a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:13.981821 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efb83e-6738-4078-84e6-880f85fa030d None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:13.982431 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efb83e-6738-4078-84e6-880f85fa030d None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:13.982939 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efb83e-6738-4078-84e6-880f85fa030d None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:13.984469 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 13/23] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 03:50:13.991561 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7af71-fa97-46db-a88c-071bf229a1e7 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:13.992101 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7af71-fa97-46db-a88c-071bf229a1e7 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:13.992619 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7af71-fa97-46db-a88c-071bf229a1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:14.028582 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-d4d7af71-fa97-46db-a88c-071bf229a1e7 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:14.031445 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-d4d7af71-fa97-46db-a88c-071bf229a1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:14.069406 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 11/24] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:14.071235 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82082b23-9c37-464b-b6a8-cd5a01e9b388 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:14.076940 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82082b23-9c37-464b-b6a8-cd5a01e9b388 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:14.078309 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82082b23-9c37-464b-b6a8-cd5a01e9b388 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:14.079820 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 12/25] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:14.087220 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0dc67-d317-4e97-820c-f5426af37dd6 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:14.087844 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0dc67-d317-4e97-820c-f5426af37dd6 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:14.088389 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0dc67-d317-4e97-820c-f5426af37dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:14.118451 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-14e0dc67-d317-4e97-820c-f5426af37dd6 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:14.121919 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-14e0dc67-d317-4e97-820c-f5426af37dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:14.185095 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 14/26] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 19 03:50:14.208406 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:14.235773 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 13/27] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:14.506768 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b837cbe-7e50-4169-9a97-075946f6d739 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:14.507409 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b837cbe-7e50-4169-9a97-075946f6d739 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:14.507897 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b837cbe-7e50-4169-9a97-075946f6d739 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:14.509487 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 15/28] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:14.514977 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef53736-6bcf-4e1c-8435-c4e3c65b6e23 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:14.515268 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef53736-6bcf-4e1c-8435-c4e3c65b6e23 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:14.515553 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef53736-6bcf-4e1c-8435-c4e3c65b6e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:14.545508 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-0ef53736-6bcf-4e1c-8435-c4e3c65b6e23 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:14.546739 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-0ef53736-6bcf-4e1c-8435-c4e3c65b6e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:14.634238 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 14/29] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:14.645873 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b837cbe-7e50-4169-9a97-075946f6d739 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:14.693445 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef53736-6bcf-4e1c-8435-c4e3c65b6e23 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:14.772557 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:14.805290 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b837cbe-7e50-4169-9a97-075946f6d739 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:14.874263 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593d881-ea2f-4aa5-87c9-a201bd16d71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:14.874934 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593d881-ea2f-4aa5-87c9-a201bd16d71f None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:14.875219 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593d881-ea2f-4aa5-87c9-a201bd16d71f None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:14.875490 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593d881-ea2f-4aa5-87c9-a201bd16d71f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:14.893435 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593d881-ea2f-4aa5-87c9-a201bd16d71f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:14.898215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-e593d881-ea2f-4aa5-87c9-a201bd16d71f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:50:14.898215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:14.898215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:14.898215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:14.898215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:14.898215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:14.898215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:14.898215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:14.898215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:14.898215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:14.898215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:14.898215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:14.898215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:14.898215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:14.898215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:14.898215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:14.899079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:14.899079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:14.899079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:14.899079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:14.899079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:14.899079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:14.899079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:14.899079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:14.899079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:14.899079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:14.899079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:14.899079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:14.899079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:14.899079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:14.899079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:14.899079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:14.899867 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:14.899867 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:14.899867 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:14.899867 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:14.899867 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:14.899867 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:14.899867 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:14.899867 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:14.899867 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:14.899867 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:14.899867 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:50:14.899867 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:50:14.899867 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 16/30] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 03:50:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:50:14.904918 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593d881-ea2f-4aa5-87c9-a201bd16d71f None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:14.914722 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef53736-6bcf-4e1c-8435-c4e3c65b6e23 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:14.923708 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:14.986432 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee9d4b-7f0a-4d41-9135-ea4b7135c912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:14.987796 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee9d4b-7f0a-4d41-9135-ea4b7135c912 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:14.988079 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee9d4b-7f0a-4d41-9135-ea4b7135c912 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:14.988349 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee9d4b-7f0a-4d41-9135-ea4b7135c912 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:15.010497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee9d4b-7f0a-4d41-9135-ea4b7135c912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:15.012175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee9d4b-7f0a-4d41-9135-ea4b7135c912 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:15.021215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593d881-ea2f-4aa5-87c9-a201bd16d71f None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:15.039016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-85ee9d4b-7f0a-4d41-9135-ea4b7135c912 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:50:15.039016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:15.039016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:15.039016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:15.039016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:15.039016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:15.039016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:15.039016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:15.039016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:15.039016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:15.039016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:15.039016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:15.039016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:50:15.039016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:50:15.039016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:50:15.039016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:50:15.039905 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:15.039905 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:15.039905 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:15.039905 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:15.039905 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:15.039905 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:15.039905 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:15.039905 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:15.039905 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:15.039905 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:15.039905 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:15.039905 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:15.039905 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:15.039905 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:15.039905 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:15.039905 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:15.039905 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:50:15.040756 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:50:15.040756 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:50:15.040756 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:50:15.040756 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 15/31] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 03:50:15.041391 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee9d4b-7f0a-4d41-9135-ea4b7135c912 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:15.066249 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1c16a-adc0-40d2-bc9d-8b5a70a886d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:15.066886 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1c16a-adc0-40d2-bc9d-8b5a70a886d3 None admin] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:15.067135 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1c16a-adc0-40d2-bc9d-8b5a70a886d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:15.067407 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1c16a-adc0-40d2-bc9d-8b5a70a886d3 None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:15.068070 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1c16a-adc0-40d2-bc9d-8b5a70a886d3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:15.073817 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1c16a-adc0-40d2-bc9d-8b5a70a886d3 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:15.080455 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:15.169404 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee9d4b-7f0a-4d41-9135-ea4b7135c912 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:15.215221 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87bac73-3076-488f-9981-0957b6502f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:15.215891 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bac73-3076-488f-9981-0957b6502f67 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:15.216334 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bac73-3076-488f-9981-0957b6502f67 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:15.216806 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bac73-3076-488f-9981-0957b6502f67 None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:15.217734 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87bac73-3076-488f-9981-0957b6502f67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:15.218182 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87bac73-3076-488f-9981-0957b6502f67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:15.219719 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87bac73-3076-488f-9981-0957b6502f67 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:15.234543 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 16/32] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:50:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:15.235666 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87bac73-3076-488f-9981-0957b6502f67 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:15.241556 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 17/33] 10.222.0.43 () {60 vars in 1131 bytes} [Fri Aug 19 03:50:14 2022] POST /identity/v3/roles => generated 219 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:50:15.242673 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1c16a-adc0-40d2-bc9d-8b5a70a886d3 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:15.265876 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:15.371963 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87bac73-3076-488f-9981-0957b6502f67 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:15.418587 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9251f-d8bc-46b7-bec8-a52514e026bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:15.419689 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9251f-d8bc-46b7-bec8-a52514e026bc None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:15.420180 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9251f-d8bc-46b7-bec8-a52514e026bc None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:15.420689 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9251f-d8bc-46b7-bec8-a52514e026bc None admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:15.421886 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9251f-d8bc-46b7-bec8-a52514e026bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:15.422550 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9251f-d8bc-46b7-bec8-a52514e026bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:15.424769 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9251f-d8bc-46b7-bec8-a52514e026bc None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:15.438831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 17/34] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:15.440382 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9251f-d8bc-46b7-bec8-a52514e026bc None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:15.457815 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1c16a-adc0-40d2-bc9d-8b5a70a886d3 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:15.540919 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:15.561647 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a948b20-5700-40d8-97ce-172d4402f760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:15.562354 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a948b20-5700-40d8-97ce-172d4402f760 None admin] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:15.564190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a948b20-5700-40d8-97ce-172d4402f760 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:15.564586 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a948b20-5700-40d8-97ce-172d4402f760 None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:15.565364 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a948b20-5700-40d8-97ce-172d4402f760 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:15.566721 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9251f-d8bc-46b7-bec8-a52514e026bc None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:15.567032 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a948b20-5700-40d8-97ce-172d4402f760 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:15.585161 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 18/35] 10.222.0.43 () {60 vars in 1131 bytes} [Fri Aug 19 03:50:15 2022] POST /identity/v3/roles => generated 225 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:50:15.586180 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a948b20-5700-40d8-97ce-172d4402f760 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:15.628258 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c4584-e11b-4816-8d9c-8cb428876521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:15.629198 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c4584-e11b-4816-8d9c-8cb428876521 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:15.629667 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c4584-e11b-4816-8d9c-8cb428876521 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:15.630141 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c4584-e11b-4816-8d9c-8cb428876521 None admin] PATH_INFO: `/v3/users/3297fc4b647c4c1aa4dde010a58c50d8` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:15.632117 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c4584-e11b-4816-8d9c-8cb428876521 None admin] RBAC: Authorizing `identity:get_user(user_id=3297fc4b647c4c1aa4dde010a58c50d8)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:15.633892 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c4584-e11b-4816-8d9c-8cb428876521 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:15.635876 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 18/36] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:15 2022] GET /identity/v3/users/3297fc4b647c4c1aa4dde010a58c50d8 => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:15.656219 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c4584-e11b-4816-8d9c-8cb428876521 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:15.661855 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:15.776948 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a948b20-5700-40d8-97ce-172d4402f760 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:15.831466 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a3a2a-c3f3-4ad5-842b-90cebce1a00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:15.832447 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a3a2a-c3f3-4ad5-842b-90cebce1a00d None admin] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:15.832769 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a3a2a-c3f3-4ad5-842b-90cebce1a00d None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:15.833051 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a3a2a-c3f3-4ad5-842b-90cebce1a00d None admin] PATH_INFO: `/v3/projects` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:15.834261 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a3a2a-c3f3-4ad5-842b-90cebce1a00d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:15.835787 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a3a2a-c3f3-4ad5-842b-90cebce1a00d None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:15.839539 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c4584-e11b-4816-8d9c-8cb428876521 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:15.881160 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 19/37] 10.222.0.43 () {60 vars in 1141 bytes} [Fri Aug 19 03:50:15 2022] POST /identity/v3/projects => generated 301 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:50:15.882437 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47057deb-7760-494a-8e3a-11c3ed43bd37 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:15.882726 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47057deb-7760-494a-8e3a-11c3ed43bd37 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:15.883002 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47057deb-7760-494a-8e3a-11c3ed43bd37 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:15.884408 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 20/38] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:15.892580 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185d1a1-56a5-40bd-bc36-81dd2c7db6fe None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:15.892902 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185d1a1-56a5-40bd-bc36-81dd2c7db6fe None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:15.893703 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185d1a1-56a5-40bd-bc36-81dd2c7db6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:15.899122 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cced996-1af2-47c7-a4e0-a1edc5ee5857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:15.900505 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cced996-1af2-47c7-a4e0-a1edc5ee5857 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:15.901016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cced996-1af2-47c7-a4e0-a1edc5ee5857 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:15.901503 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cced996-1af2-47c7-a4e0-a1edc5ee5857 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:15.904224 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cced996-1af2-47c7-a4e0-a1edc5ee5857 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:15.906145 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cced996-1af2-47c7-a4e0-a1edc5ee5857 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:15.908319 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 19/39] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:50:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:50:15.918995 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cced996-1af2-47c7-a4e0-a1edc5ee5857 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:15.920760 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-2185d1a1-56a5-40bd-bc36-81dd2c7db6fe None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:15.922829 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-2185d1a1-56a5-40bd-bc36-81dd2c7db6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:15.941624 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:16.009100 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 21/40] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:16.010700 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b900a-aeff-4de5-9609-0ea1d25caab1 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:16.010992 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b900a-aeff-4de5-9609-0ea1d25caab1 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:16.011279 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b900a-aeff-4de5-9609-0ea1d25caab1 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:16.020959 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 22/41] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:16 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:16.022087 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd88da2-6688-4c90-9028-e1c1b883ba08 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:16.022622 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd88da2-6688-4c90-9028-e1c1b883ba08 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:16.022708 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd88da2-6688-4c90-9028-e1c1b883ba08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:16.053588 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-6dd88da2-6688-4c90-9028-e1c1b883ba08 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:16.056110 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-6dd88da2-6688-4c90-9028-e1c1b883ba08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:16.069040 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cced996-1af2-47c7-a4e0-a1edc5ee5857 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:16.095800 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:16.118542 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598183c-1c12-4044-a84b-49ededc7d55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:16.119246 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598183c-1c12-4044-a84b-49ededc7d55e None admin] REQUEST_METHOD: `PUT` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:16.121952 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598183c-1c12-4044-a84b-49ededc7d55e None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:16.121952 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598183c-1c12-4044-a84b-49ededc7d55e None admin] PATH_INFO: `/v3/domains/default/users/3297fc4b647c4c1aa4dde010a58c50d8/roles/e154509f216e4ae59f74044aa234ddde` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:16.125427 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598183c-1c12-4044-a84b-49ededc7d55e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3297fc4b647c4c1aa4dde010a58c50d8, role_id=e154509f216e4ae59f74044aa234ddde)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:16.128295 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598183c-1c12-4044-a84b-49ededc7d55e None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:16.150152 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 23/42] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:16.257274 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 20/43] 10.222.0.43 () {58 vars in 1361 bytes} [Fri Aug 19 03:50:15 2022] PUT /identity/v3/domains/default/users/3297fc4b647c4c1aa4dde010a58c50d8/roles/e154509f216e4ae59f74044aa234ddde => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 03:50:16.359302 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd88da2-6688-4c90-9028-e1c1b883ba08 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:16.468625 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd88da2-6688-4c90-9028-e1c1b883ba08 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:16.479458 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598183c-1c12-4044-a84b-49ededc7d55e None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:16.504335 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e1525-f9b9-418d-97de-8fee39a2a0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:16.505037 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e1525-f9b9-418d-97de-8fee39a2a0f0 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:16.505319 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e1525-f9b9-418d-97de-8fee39a2a0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:16.505596 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e1525-f9b9-418d-97de-8fee39a2a0f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:16.506718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e1525-f9b9-418d-97de-8fee39a2a0f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:16.508184 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e1525-f9b9-418d-97de-8fee39a2a0f0 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:16.509900 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 24/44] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:50:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:16.515473 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e1525-f9b9-418d-97de-8fee39a2a0f0 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:16.552002 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:16.566437 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:16.592472 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598183c-1c12-4044-a84b-49ededc7d55e None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:16.624821 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e1525-f9b9-418d-97de-8fee39a2a0f0 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:16.632573 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e80b5-656e-49a2-90f2-d856a1212e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:16.633412 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e80b5-656e-49a2-90f2-d856a1212e0b None admin] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:16.633697 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e80b5-656e-49a2-90f2-d856a1212e0b None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:16.633979 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e80b5-656e-49a2-90f2-d856a1212e0b None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:16.634660 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e80b5-656e-49a2-90f2-d856a1212e0b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:16.636272 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e80b5-656e-49a2-90f2-d856a1212e0b None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:16.655947 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 21/45] 10.222.0.43 () {60 vars in 1131 bytes} [Fri Aug 19 03:50:16 2022] POST /identity/v3/roles => generated 223 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 03:50:16.662879 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6e277-c242-4493-b734-8b2c4fcf26c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:16.663520 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6e277-c242-4493-b734-8b2c4fcf26c8 None admin] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:16.663808 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6e277-c242-4493-b734-8b2c4fcf26c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:16.664085 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6e277-c242-4493-b734-8b2c4fcf26c8 None admin] PATH_INFO: `/v3/projects` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:16.664785 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d6e277-c242-4493-b734-8b2c4fcf26c8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:16.666334 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d6e277-c242-4493-b734-8b2c4fcf26c8 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:16.698046 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 25/46] 10.222.0.43 () {60 vars in 1141 bytes} [Fri Aug 19 03:50:16 2022] POST /identity/v3/projects => generated 312 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 03:50:18.419747 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906a3cc-37ec-47f1-a3f6-c045a5595087 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:18.420288 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906a3cc-37ec-47f1-a3f6-c045a5595087 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:18.420288 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906a3cc-37ec-47f1-a3f6-c045a5595087 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:18.421685 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 22/47] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:18.427049 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d55507-7627-49ff-8650-22b5ea7a0d33 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:18.427448 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d55507-7627-49ff-8650-22b5ea7a0d33 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:18.427547 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d55507-7627-49ff-8650-22b5ea7a0d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:18.445328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-28d55507-7627-49ff-8650-22b5ea7a0d33 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:18.446512 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-28d55507-7627-49ff-8650-22b5ea7a0d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:18.511571 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 26/48] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:18.834068 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906a3cc-37ec-47f1-a3f6-c045a5595087 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:18.885776 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a363c-5024-414f-a1e9-98b66683d0b6 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:18.886194 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a363c-5024-414f-a1e9-98b66683d0b6 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:18.886482 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a363c-5024-414f-a1e9-98b66683d0b6 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:18.887832 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 27/49] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:18.892750 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a3612-57f1-4a0a-9652-3cfb707eb993 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:18.893042 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a3612-57f1-4a0a-9652-3cfb707eb993 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:18.893325 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a3612-57f1-4a0a-9652-3cfb707eb993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:18.911590 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-f30a3612-57f1-4a0a-9652-3cfb707eb993 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:18.912921 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-f30a3612-57f1-4a0a-9652-3cfb707eb993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:18.923628 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:18.938261 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906a3cc-37ec-47f1-a3f6-c045a5595087 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:18.971328 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42787ba4-ff79-4664-ba2d-091410d14183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:18.971948 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42787ba4-ff79-4664-ba2d-091410d14183 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:18.972225 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42787ba4-ff79-4664-ba2d-091410d14183 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:18.972519 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42787ba4-ff79-4664-ba2d-091410d14183 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:18.976154 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:18.984509 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 28/50] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 03:50:18.985774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42787ba4-ff79-4664-ba2d-091410d14183 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:18.992200 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-42787ba4-ff79-4664-ba2d-091410d14183 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:50:18.992200 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:18.992200 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:18.992200 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:18.992200 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:18.992200 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:18.992200 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:18.992200 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:18.992200 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:18.992200 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:18.992200 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:18.992200 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:18.992200 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:18.992200 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:18.992200 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:18.992200 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:18.993189 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:18.993189 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:18.993189 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:18.993189 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:18.993189 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:18.993189 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:18.993189 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:18.993189 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:18.993189 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:18.993189 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:18.993189 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:18.993189 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:18.993189 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:18.993189 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:18.993189 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:18.993189 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:18.994147 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:18.994147 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:18.994147 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:18.994147 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:18.994147 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:18.994147 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:18.994147 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:18.994147 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:18.994147 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:18.994147 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:18.994147 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:50:18.994147 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:50:18.994147 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 23/51] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 03:50:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:50:19.000775 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a3612-57f1-4a0a-9652-3cfb707eb993 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:19.098204 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a3612-57f1-4a0a-9652-3cfb707eb993 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:19.131255 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d81865-324e-4a00-9787-c9435886fee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:19.131854 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d81865-324e-4a00-9787-c9435886fee0 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:19.132135 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d81865-324e-4a00-9787-c9435886fee0 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:19.132410 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d81865-324e-4a00-9787-c9435886fee0 None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:19.133168 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d81865-324e-4a00-9787-c9435886fee0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:19.133471 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d81865-324e-4a00-9787-c9435886fee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:19.134843 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d81865-324e-4a00-9787-c9435886fee0 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:19.143113 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 29/52] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:50:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:19.148890 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42787ba4-ff79-4664-ba2d-091410d14183 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:19.250005 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42787ba4-ff79-4664-ba2d-091410d14183 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:19.284128 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479d41b-3690-4f17-9666-70128e878e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:19.284855 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479d41b-3690-4f17-9666-70128e878e7b None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:19.285134 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479d41b-3690-4f17-9666-70128e878e7b None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:19.285402 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479d41b-3690-4f17-9666-70128e878e7b None admin] PATH_INFO: `/v3/users/3297fc4b647c4c1aa4dde010a58c50d8` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:19.286525 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479d41b-3690-4f17-9666-70128e878e7b None admin] RBAC: Authorizing `identity:get_user(user_id=3297fc4b647c4c1aa4dde010a58c50d8)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:19.287965 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479d41b-3690-4f17-9666-70128e878e7b None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:19.289547 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 24/53] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:19 2022] GET /identity/v3/users/3297fc4b647c4c1aa4dde010a58c50d8 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:50:19.294934 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d81865-324e-4a00-9787-c9435886fee0 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:19.305047 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479d41b-3690-4f17-9666-70128e878e7b None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:19.306421 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:19.366148 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:19.398624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d81865-324e-4a00-9787-c9435886fee0 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:19.404077 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479d41b-3690-4f17-9666-70128e878e7b None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:19.431934 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062524d-f0bd-4eb7-aab4-3ddba265673a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:19.432602 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062524d-f0bd-4eb7-aab4-3ddba265673a None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:19.432882 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062524d-f0bd-4eb7-aab4-3ddba265673a None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:19.433158 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062524d-f0bd-4eb7-aab4-3ddba265673a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:19.434291 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062524d-f0bd-4eb7-aab4-3ddba265673a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:19.435739 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062524d-f0bd-4eb7-aab4-3ddba265673a None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:19.437480 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 30/54] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:50:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:19.437922 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0c378-57d2-413a-862f-4dd7c95d16c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:19.438555 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0c378-57d2-413a-862f-4dd7c95d16c4 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:19.438839 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0c378-57d2-413a-862f-4dd7c95d16c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:19.439172 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0c378-57d2-413a-862f-4dd7c95d16c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:19.440396 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0c378-57d2-413a-862f-4dd7c95d16c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:19.441866 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0c378-57d2-413a-862f-4dd7c95d16c4 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:19.443114 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062524d-f0bd-4eb7-aab4-3ddba265673a None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:19.443701 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 25/55] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:50:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:50:19.448875 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0c378-57d2-413a-862f-4dd7c95d16c4 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:19.520689 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:19.543478 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062524d-f0bd-4eb7-aab4-3ddba265673a None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:19.547628 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0c378-57d2-413a-862f-4dd7c95d16c4 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:19.575771 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:19.576530 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3250f-96bb-456f-af10-cf575ad1840b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:19.577113 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3250f-96bb-456f-af10-cf575ad1840b None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:19.577527 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3250f-96bb-456f-af10-cf575ad1840b None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:19.577807 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3250f-96bb-456f-af10-cf575ad1840b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:19.578554 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3250f-96bb-456f-af10-cf575ad1840b None admin] RBAC: Adding query filter params (role.id=e154509f216e4ae59f74044aa234ddde, scope.domain.id=default, user.id=3297fc4b647c4c1aa4dde010a58c50d8) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:19.578859 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3250f-96bb-456f-af10-cf575ad1840b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:19.580941 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3250f-96bb-456f-af10-cf575ad1840b None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:19.581879 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22ba7a-c2f4-48d4-9692-0bf171b9fb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:19.582484 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22ba7a-c2f4-48d4-9692-0bf171b9fb19 None admin] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:19.582767 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22ba7a-c2f4-48d4-9692-0bf171b9fb19 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:19.583042 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22ba7a-c2f4-48d4-9692-0bf171b9fb19 None admin] PATH_INFO: `/v3/projects` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:19.583675 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22ba7a-c2f4-48d4-9692-0bf171b9fb19 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:19.585143 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22ba7a-c2f4-48d4-9692-0bf171b9fb19 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:19.586657 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 31/56] 10.222.0.43 () {56 vars in 1322 bytes} [Fri Aug 19 03:50:19 2022] GET /identity/v3/role_assignments?user.id=3297fc4b647c4c1aa4dde010a58c50d8&scope.domain.id=default&role.id=e154509f216e4ae59f74044aa234ddde => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:50:19.615351 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 26/57] 10.222.0.43 () {60 vars in 1140 bytes} [Fri Aug 19 03:50:19 2022] POST /identity/v3/projects => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 03:50:21.791330 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d0bdb-1775-4a6e-86bf-9c8fff009ce4 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:21.791848 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d0bdb-1775-4a6e-86bf-9c8fff009ce4 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:21.791932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d0bdb-1775-4a6e-86bf-9c8fff009ce4 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:21.793238 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 32/58] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:21.798287 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f0056-9ad2-44b3-8d25-7a1916eb94a8 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:21.798672 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f0056-9ad2-44b3-8d25-7a1916eb94a8 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:21.798844 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f0056-9ad2-44b3-8d25-7a1916eb94a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:21.817237 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-7b0f0056-9ad2-44b3-8d25-7a1916eb94a8 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:21.818760 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-7b0f0056-9ad2-44b3-8d25-7a1916eb94a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:21.883668 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 27/59] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:22.206623 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d0bdb-1775-4a6e-86bf-9c8fff009ce4 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:22.305904 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d0bdb-1775-4a6e-86bf-9c8fff009ce4 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:22.338233 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6838f-7569-45be-86b7-4be90bf9456c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:22.338855 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6838f-7569-45be-86b7-4be90bf9456c None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:22.339140 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6838f-7569-45be-86b7-4be90bf9456c None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:22.339421 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6838f-7569-45be-86b7-4be90bf9456c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:22.340554 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c6838f-7569-45be-86b7-4be90bf9456c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:22.342003 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c6838f-7569-45be-86b7-4be90bf9456c None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:22.343543 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 33/60] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:50:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:22.349188 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f0056-9ad2-44b3-8d25-7a1916eb94a8 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:22.444376 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f0056-9ad2-44b3-8d25-7a1916eb94a8 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:22.457677 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:22.478695 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a4452-d6dd-469c-a2eb-5b4c6e594ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:22.479286 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a4452-d6dd-469c-a2eb-5b4c6e594ca5 None admin] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:22.479563 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a4452-d6dd-469c-a2eb-5b4c6e594ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:22.479838 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a4452-d6dd-469c-a2eb-5b4c6e594ca5 None admin] PATH_INFO: `/v3/users` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:22.480475 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a4452-d6dd-469c-a2eb-5b4c6e594ca5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:22.481937 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a4452-d6dd-469c-a2eb-5b4c6e594ca5 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:22.508627 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 28/61] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 03:50:22 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 03:50:25.775408 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c4152-40ef-40f6-b225-668ccf08d718 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:25.776422 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c4152-40ef-40f6-b225-668ccf08d718 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:25.776935 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c4152-40ef-40f6-b225-668ccf08d718 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:25.778790 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 34/62] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:25.784146 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6f5b3-eb64-42ad-8ed0-991b19bfce48 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:25.784968 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6f5b3-eb64-42ad-8ed0-991b19bfce48 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:25.785444 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6f5b3-eb64-42ad-8ed0-991b19bfce48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:25.807898 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-5ce6f5b3-eb64-42ad-8ed0-991b19bfce48 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:25.809446 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-5ce6f5b3-eb64-42ad-8ed0-991b19bfce48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:25.886524 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f0359-ff90-4353-9ac7-d2e7727c4f82 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:25.886837 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f0359-ff90-4353-9ac7-d2e7727c4f82 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:25.887079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f0359-ff90-4353-9ac7-d2e7727c4f82 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:25.888422 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 35/63] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:25.894815 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c8e5e-2a4a-4de5-b31c-d963025624a0 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:25.895326 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c8e5e-2a4a-4de5-b31c-d963025624a0 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:25.895796 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c8e5e-2a4a-4de5-b31c-d963025624a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:25.901458 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 29/64] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:25.905116 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e9f9b-2fb4-4678-b852-e8073166f531 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:25.905116 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e9f9b-2fb4-4678-b852-e8073166f531 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:25.905116 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e9f9b-2fb4-4678-b852-e8073166f531 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:25.905116 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 30/65] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:25.910556 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fa271-717e-42fa-b7d6-8f0a53d4053a None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:25.910846 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fa271-717e-42fa-b7d6-8f0a53d4053a None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:25.911124 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fa271-717e-42fa-b7d6-8f0a53d4053a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:25.926308 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-2a7c8e5e-2a4a-4de5-b31c-d963025624a0 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:25.927798 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-2a7c8e5e-2a4a-4de5-b31c-d963025624a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:25.932521 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:25.940714 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-355fa271-717e-42fa-b7d6-8f0a53d4053a None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:25.942156 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-355fa271-717e-42fa-b7d6-8f0a53d4053a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:26.052375 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 36/66] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 03:50:26.067692 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 31/67] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 03:50:26.328164 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c8e5e-2a4a-4de5-b31c-d963025624a0 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:26.462986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c8e5e-2a4a-4de5-b31c-d963025624a0 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:26.507820 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fa271-717e-42fa-b7d6-8f0a53d4053a None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:26.515827 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c685724-f5d3-4490-a6e2-a4c01ab79143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:26.516474 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c685724-f5d3-4490-a6e2-a4c01ab79143 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:26.516783 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c685724-f5d3-4490-a6e2-a4c01ab79143 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:26.517056 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c685724-f5d3-4490-a6e2-a4c01ab79143 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:26.527530 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:26.534004 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c685724-f5d3-4490-a6e2-a4c01ab79143 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:26.539137 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-3c685724-f5d3-4490-a6e2-a4c01ab79143 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 03:50:26.539137 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:26.539137 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:26.539137 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:26.539137 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:26.539137 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:26.539137 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:26.539137 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:26.539137 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:26.539137 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:26.539137 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:26.539137 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:26.539137 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:26.539137 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:26.539137 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:26.539137 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:26.540200 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:26.540200 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:26.540200 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:26.540200 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:26.540200 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:26.540200 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:26.540200 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:26.540200 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:26.540200 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:26.540200 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:26.540200 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:26.540200 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:26.540200 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:26.540200 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:26.540200 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:26.540200 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:26.541131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:26.541131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:26.541131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:26.541131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:26.541131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:26.541131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:26.541131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:26.541131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:26.541131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:26.541131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:26.541131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 03:50:26.541131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:50:26.541131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 37/68] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 03:50:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:50:26.541131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c685724-f5d3-4490-a6e2-a4c01ab79143 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:26.544812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:26.627930 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fa271-717e-42fa-b7d6-8f0a53d4053a None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:26.662713 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ee373-3a46-4231-a1f6-36e5dc35ac2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:26.663335 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ee373-3a46-4231-a1f6-36e5dc35ac2b None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:26.663607 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c685724-f5d3-4490-a6e2-a4c01ab79143 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:26.663707 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ee373-3a46-4231-a1f6-36e5dc35ac2b None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:26.663866 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ee373-3a46-4231-a1f6-36e5dc35ac2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:26.673983 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ee373-3a46-4231-a1f6-36e5dc35ac2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:26.678799 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-ce0ee373-3a46-4231-a1f6-36e5dc35ac2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:50:26.678799 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:26.678799 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:26.678799 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:26.678799 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:26.678799 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:26.678799 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:26.678799 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:26.678799 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:26.678799 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:26.678799 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:26.678799 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:26.678799 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:26.678799 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:26.678799 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:26.678799 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:26.679635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:26.679635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:26.679635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:26.679635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:26.679635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:26.679635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:26.679635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:26.679635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:26.679635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:26.679635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:26.679635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:26.679635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:26.679635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:26.679635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:26.679635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:26.679635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:26.680400 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:26.680400 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:26.680400 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:26.680400 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:26.680400 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:26.680400 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:26.680400 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:26.680400 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:26.680400 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:26.680400 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:26.680400 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:50:26.680400 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:50:26.680400 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 32/69] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:50:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 03:50:26.681349 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ee373-3a46-4231-a1f6-36e5dc35ac2b None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:26.698950 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b32a8-2c5f-4fcf-8779-db3b1c3e9beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:26.699587 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b32a8-2c5f-4fcf-8779-db3b1c3e9beb None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:26.699866 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b32a8-2c5f-4fcf-8779-db3b1c3e9beb None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:26.700142 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b32a8-2c5f-4fcf-8779-db3b1c3e9beb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:26.710688 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b32a8-2c5f-4fcf-8779-db3b1c3e9beb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:26.715344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-780b32a8-2c5f-4fcf-8779-db3b1c3e9beb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:50:26.715344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:26.715344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:26.715344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:26.715344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:26.715344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:26.715344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:26.715344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:26.715344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:26.715344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:26.715344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:26.715344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:26.715344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:26.715344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:26.715344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:26.715344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:26.716183 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:26.716183 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:26.716183 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:26.716183 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:26.716183 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:26.716183 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:26.716183 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:26.716183 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:26.716183 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:26.716183 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:26.716183 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:26.716183 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:26.716183 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:26.716183 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:26.716183 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:26.716183 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:26.722757 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:26.722757 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:26.722757 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:26.722757 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:26.722757 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:26.722757 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:26.722757 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:26.722757 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:26.722757 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:26.722757 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:26.722757 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:50:26.722757 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:50:26.722757 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 38/70] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 03:50:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:50:26.722757 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f58af1-80c3-4585-9728-51752c8ce1bb None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:26.723622 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f58af1-80c3-4585-9728-51752c8ce1bb None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:26.723622 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f58af1-80c3-4585-9728-51752c8ce1bb None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:26.723622 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 39/71] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:26.725524 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa1437-1f03-455a-b64b-d5a6f1d14326 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:26.725812 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa1437-1f03-455a-b64b-d5a6f1d14326 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:26.726090 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa1437-1f03-455a-b64b-d5a6f1d14326 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:26.727797 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 40/72] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:26.728642 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa1437-1f03-455a-b64b-d5a6f1d14326 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:26.774397 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:26.787137 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:26.787691 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ee373-3a46-4231-a1f6-36e5dc35ac2b None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:26.820315 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f7549-2483-4334-909b-fe2099db8653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:26.820950 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f7549-2483-4334-909b-fe2099db8653 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:26.821225 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f7549-2483-4334-909b-fe2099db8653 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:26.821500 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f7549-2483-4334-909b-fe2099db8653 None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:26.822157 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f7549-2483-4334-909b-fe2099db8653 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:26.822454 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f7549-2483-4334-909b-fe2099db8653 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:26.823839 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f7549-2483-4334-909b-fe2099db8653 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:26.828546 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa1437-1f03-455a-b64b-d5a6f1d14326 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:26.832130 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 33/73] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:50:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:26.832929 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f7549-2483-4334-909b-fe2099db8653 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:26.862814 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181cfe0-eec4-4d76-a92b-a364417b86ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:26.863413 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181cfe0-eec4-4d76-a92b-a364417b86ce None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:26.863696 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181cfe0-eec4-4d76-a92b-a364417b86ce None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:26.864011 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181cfe0-eec4-4d76-a92b-a364417b86ce None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:26.864702 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181cfe0-eec4-4d76-a92b-a364417b86ce None admin] RBAC: Adding query filter params (name=member) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:26.865008 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181cfe0-eec4-4d76-a92b-a364417b86ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:26.866389 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181cfe0-eec4-4d76-a92b-a364417b86ce None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:26.874096 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 41/74] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 03:50:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:26.875241 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ea926-bd86-405a-b3a0-692a1c2d5424 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:26.875530 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ea926-bd86-405a-b3a0-692a1c2d5424 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:26.875811 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ea926-bd86-405a-b3a0-692a1c2d5424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:26.898554 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-a06ea926-bd86-405a-b3a0-692a1c2d5424 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:26.899180 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-a06ea926-bd86-405a-b3a0-692a1c2d5424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:26.933936 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f7549-2483-4334-909b-fe2099db8653 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:26.964405 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 42/75] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:26.965848 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e878290-6d73-405c-b9ac-62e2abcae704 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:26.966142 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e878290-6d73-405c-b9ac-62e2abcae704 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:26.966416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e878290-6d73-405c-b9ac-62e2abcae704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:26.967813 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4a68d-debd-46a3-88bc-f2e35a57c7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:26.968421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4a68d-debd-46a3-88bc-f2e35a57c7ca None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:26.969284 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4a68d-debd-46a3-88bc-f2e35a57c7ca None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:26.969591 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4a68d-debd-46a3-88bc-f2e35a57c7ca None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:26.970310 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4a68d-debd-46a3-88bc-f2e35a57c7ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:26.970621 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4a68d-debd-46a3-88bc-f2e35a57c7ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:26.971997 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4a68d-debd-46a3-88bc-f2e35a57c7ca None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:26.984305 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-4e878290-6d73-405c-b9ac-62e2abcae704 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:26.985562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-4e878290-6d73-405c-b9ac-62e2abcae704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:26.986055 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 34/76] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:50:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:26.989355 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4a68d-debd-46a3-88bc-f2e35a57c7ca None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:27.010146 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:27.036922 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:27.063944 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 43/77] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:27.065127 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e878290-6d73-405c-b9ac-62e2abcae704 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:27.120315 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4a68d-debd-46a3-88bc-f2e35a57c7ca None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:27.161843 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a690d2-4112-40c5-8678-b68453115175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:27.162853 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a690d2-4112-40c5-8678-b68453115175 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:27.163430 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a690d2-4112-40c5-8678-b68453115175 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:27.163905 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a690d2-4112-40c5-8678-b68453115175 None admin] PATH_INFO: `/v3/users/20953f4ef7cb44fe9392681065db4996` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:27.181978 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a690d2-4112-40c5-8678-b68453115175 None admin] RBAC: Authorizing `identity:get_user(user_id=20953f4ef7cb44fe9392681065db4996)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:27.183725 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a690d2-4112-40c5-8678-b68453115175 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:27.186293 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 35/78] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:26 2022] GET /identity/v3/users/20953f4ef7cb44fe9392681065db4996 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:27.187258 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a690d2-4112-40c5-8678-b68453115175 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:27.206202 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e878290-6d73-405c-b9ac-62e2abcae704 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:27.254703 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a967862-9a3c-44bd-b016-cac5691eee4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:27.255596 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a967862-9a3c-44bd-b016-cac5691eee4a None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:27.255884 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a967862-9a3c-44bd-b016-cac5691eee4a None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:27.256166 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a967862-9a3c-44bd-b016-cac5691eee4a None admin] PATH_INFO: `/v3/users/20953f4ef7cb44fe9392681065db4996` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:27.258045 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a967862-9a3c-44bd-b016-cac5691eee4a None admin] RBAC: Authorizing `identity:get_user(user_id=20953f4ef7cb44fe9392681065db4996)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:27.259868 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a967862-9a3c-44bd-b016-cac5691eee4a None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:27.262373 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 44/79] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:27 2022] GET /identity/v3/users/20953f4ef7cb44fe9392681065db4996 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:27.262956 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a967862-9a3c-44bd-b016-cac5691eee4a None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:27.270779 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:27.313689 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a690d2-4112-40c5-8678-b68453115175 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:27.322099 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:27.351568 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acb596-f1cd-41f3-9c99-1d2f81c13d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:27.352199 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acb596-f1cd-41f3-9c99-1d2f81c13d9b None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:27.352498 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acb596-f1cd-41f3-9c99-1d2f81c13d9b None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:27.352785 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acb596-f1cd-41f3-9c99-1d2f81c13d9b None admin] PATH_INFO: `/v3/users/3297fc4b647c4c1aa4dde010a58c50d8` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:27.354034 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acb596-f1cd-41f3-9c99-1d2f81c13d9b None admin] RBAC: Authorizing `identity:get_user(user_id=3297fc4b647c4c1aa4dde010a58c50d8)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:27.355635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acb596-f1cd-41f3-9c99-1d2f81c13d9b None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:27.357373 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 36/80] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:27 2022] GET /identity/v3/users/3297fc4b647c4c1aa4dde010a58c50d8 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:27.362735 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acb596-f1cd-41f3-9c99-1d2f81c13d9b None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:27.376697 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a967862-9a3c-44bd-b016-cac5691eee4a None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:27.411476 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e5494-af95-4a11-a753-364d98091749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:27.412134 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e5494-af95-4a11-a753-364d98091749 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:27.412364 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e5494-af95-4a11-a753-364d98091749 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:27.412685 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e5494-af95-4a11-a753-364d98091749 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:27.462261 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acb596-f1cd-41f3-9c99-1d2f81c13d9b None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:27.478081 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e5494-af95-4a11-a753-364d98091749 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:27.479566 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e5494-af95-4a11-a753-364d98091749 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:27.494808 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da425533-0690-4945-8a97-1f0dd55d13fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:27.495406 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da425533-0690-4945-8a97-1f0dd55d13fa None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:27.495680 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da425533-0690-4945-8a97-1f0dd55d13fa None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:27.495953 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da425533-0690-4945-8a97-1f0dd55d13fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:27.506509 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:27.528585 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:27.563052 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da425533-0690-4945-8a97-1f0dd55d13fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:27.564548 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da425533-0690-4945-8a97-1f0dd55d13fa None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:27.579307 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 45/81] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:50:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:50:27.580136 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e5494-af95-4a11-a753-364d98091749 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:27.659743 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 37/82] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:50:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:50:27.660605 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da425533-0690-4945-8a97-1f0dd55d13fa None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:27.680302 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e5494-af95-4a11-a753-364d98091749 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:27.700519 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:27.713522 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b8c69-7a32-4e55-b3f5-04c87dd0390b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:27.714172 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b8c69-7a32-4e55-b3f5-04c87dd0390b None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:27.714449 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b8c69-7a32-4e55-b3f5-04c87dd0390b None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:27.714721 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b8c69-7a32-4e55-b3f5-04c87dd0390b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:27.715815 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b8c69-7a32-4e55-b3f5-04c87dd0390b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:27.717293 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b8c69-7a32-4e55-b3f5-04c87dd0390b None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:27.718857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 46/83] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:50:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:27.719613 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b8c69-7a32-4e55-b3f5-04c87dd0390b None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:27.736674 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:27.758221 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da425533-0690-4945-8a97-1f0dd55d13fa None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:27.792176 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251463a9-1dd0-411b-9c54-34d90c33d461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:27.792802 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251463a9-1dd0-411b-9c54-34d90c33d461 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:27.793469 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251463a9-1dd0-411b-9c54-34d90c33d461 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:27.793748 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251463a9-1dd0-411b-9c54-34d90c33d461 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:27.817530 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b8c69-7a32-4e55-b3f5-04c87dd0390b None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:27.850397 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e73561-60f3-4dc7-a91c-bf5fa08cf7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:27.851018 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e73561-60f3-4dc7-a91c-bf5fa08cf7ed None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:27.851300 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e73561-60f3-4dc7-a91c-bf5fa08cf7ed None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:27.851578 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e73561-60f3-4dc7-a91c-bf5fa08cf7ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:27.860075 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251463a9-1dd0-411b-9c54-34d90c33d461 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:27.861570 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251463a9-1dd0-411b-9c54-34d90c33d461 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:27.862027 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e73561-60f3-4dc7-a91c-bf5fa08cf7ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:27.866771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-01e73561-60f3-4dc7-a91c-bf5fa08cf7ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:50:27.866771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:27.866771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:27.866771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:27.866771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:27.866771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:27.866771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:27.866771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:27.866771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:27.866771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:27.866771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:27.866771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:27.866771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:27.866771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:27.866771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:27.866771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:27.867624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:27.867624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:27.867624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:27.867624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:27.867624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:27.867624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:27.867624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:27.867624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:27.867624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:27.867624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:27.867624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:27.867624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:27.867624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:27.867624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:27.867624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:27.867624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:27.868517 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:27.868517 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:27.868517 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:27.868517 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:27.868517 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:27.868517 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:27.868517 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:27.868517 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:27.868517 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:27.868517 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:27.868517 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:50:27.868517 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:50:27.868517 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 47/84] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:50:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:50:27.869332 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e73561-60f3-4dc7-a91c-bf5fa08cf7ed None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:27.904650 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:27.947135 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:27.964675 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 38/85] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:50:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:50:27.965509 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251463a9-1dd0-411b-9c54-34d90c33d461 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:27.973583 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e73561-60f3-4dc7-a91c-bf5fa08cf7ed None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:28.006793 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c9098-f38b-4378-a192-d6d77d0e6f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:28.007443 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c9098-f38b-4378-a192-d6d77d0e6f70 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:28.007721 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c9098-f38b-4378-a192-d6d77d0e6f70 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:28.007996 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c9098-f38b-4378-a192-d6d77d0e6f70 None admin] PATH_INFO: `/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:28.009145 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c9098-f38b-4378-a192-d6d77d0e6f70 None admin] RBAC: Authorizing `identity:get_project(project_id=1cba8bf5387546e18ca3f132b9f78bc1)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:28.010610 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c9098-f38b-4378-a192-d6d77d0e6f70 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:28.012222 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 48/86] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:50:27 2022] GET /identity/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:28.012222 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c9098-f38b-4378-a192-d6d77d0e6f70 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:28.071524 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251463a9-1dd0-411b-9c54-34d90c33d461 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:28.104922 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d178f7-4a0b-42e3-9902-6f45a85fc579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:28.105546 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d178f7-4a0b-42e3-9902-6f45a85fc579 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:28.105822 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d178f7-4a0b-42e3-9902-6f45a85fc579 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:28.106095 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d178f7-4a0b-42e3-9902-6f45a85fc579 None admin] PATH_INFO: `/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:28.107278 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d178f7-4a0b-42e3-9902-6f45a85fc579 None admin] RBAC: Authorizing `identity:get_project(project_id=1cba8bf5387546e18ca3f132b9f78bc1)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:28.108763 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d178f7-4a0b-42e3-9902-6f45a85fc579 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:28.109582 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c9098-f38b-4378-a192-d6d77d0e6f70 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:28.110436 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 39/87] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:50:27 2022] GET /identity/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:28.111188 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d178f7-4a0b-42e3-9902-6f45a85fc579 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:28.121089 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:28.148880 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72218b-5fa8-4cc6-abba-14b113fce7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:28.149477 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72218b-5fa8-4cc6-abba-14b113fce7ec None admin] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:28.149755 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72218b-5fa8-4cc6-abba-14b113fce7ec None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:28.150027 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72218b-5fa8-4cc6-abba-14b113fce7ec None admin] PATH_INFO: `/v3/users` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:28.150655 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72218b-5fa8-4cc6-abba-14b113fce7ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:28.152109 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72218b-5fa8-4cc6-abba-14b113fce7ec None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:28.176056 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:28.181285 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 49/88] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 03:50:28 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:50:28.182188 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72218b-5fa8-4cc6-abba-14b113fce7ec None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:28.220742 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d178f7-4a0b-42e3-9902-6f45a85fc579 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:28.258644 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad4e587-053f-44ce-b0a8-9c478c7cca85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:28.259387 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4e587-053f-44ce-b0a8-9c478c7cca85 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:28.259726 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4e587-053f-44ce-b0a8-9c478c7cca85 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:28.260075 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4e587-053f-44ce-b0a8-9c478c7cca85 None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:28.260865 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad4e587-053f-44ce-b0a8-9c478c7cca85 None admin] RBAC: Adding query filter params (name=member) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:28.261239 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad4e587-053f-44ce-b0a8-9c478c7cca85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:28.262762 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad4e587-053f-44ce-b0a8-9c478c7cca85 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:28.272197 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 40/89] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 03:50:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:28.273278 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad4e587-053f-44ce-b0a8-9c478c7cca85 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:28.302576 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72218b-5fa8-4cc6-abba-14b113fce7ec None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:28.348127 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7f74c-7ed2-4ac5-99c5-45b8e5312873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:28.348965 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7f74c-7ed2-4ac5-99c5-45b8e5312873 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:28.349355 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7f74c-7ed2-4ac5-99c5-45b8e5312873 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:28.349752 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7f74c-7ed2-4ac5-99c5-45b8e5312873 None admin] PATH_INFO: `/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:28.351011 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7f74c-7ed2-4ac5-99c5-45b8e5312873 None admin] RBAC: Authorizing `identity:get_project(project_id=1cba8bf5387546e18ca3f132b9f78bc1)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:28.352583 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7f74c-7ed2-4ac5-99c5-45b8e5312873 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:28.354246 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 50/90] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:50:28 2022] GET /identity/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:28.355795 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7f74c-7ed2-4ac5-99c5-45b8e5312873 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:28.355914 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:28.397689 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad4e587-053f-44ce-b0a8-9c478c7cca85 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:28.439478 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5eb929-38bb-4855-98ec-130780b84cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:28.440092 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5eb929-38bb-4855-98ec-130780b84cbd None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:28.440371 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5eb929-38bb-4855-98ec-130780b84cbd None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:28.440701 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5eb929-38bb-4855-98ec-130780b84cbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:28.441519 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5eb929-38bb-4855-98ec-130780b84cbd None admin] RBAC: Adding query filter params (role.id=99bf21a1487942d3be2b9bdd4483d23e, scope.project.id=1cba8bf5387546e18ca3f132b9f78bc1, user.id=20953f4ef7cb44fe9392681065db4996) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:28.443485 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5eb929-38bb-4855-98ec-130780b84cbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:28.443592 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:28.443874 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5eb929-38bb-4855-98ec-130780b84cbd None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:28.453909 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 41/91] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:50:28 2022] GET /identity/v3/role_assignments?user.id=20953f4ef7cb44fe9392681065db4996&scope.project.id=1cba8bf5387546e18ca3f132b9f78bc1&role.id=99bf21a1487942d3be2b9bdd4483d23e => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:28.454860 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5eb929-38bb-4855-98ec-130780b84cbd None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:28.494356 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7f74c-7ed2-4ac5-99c5-45b8e5312873 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:28.543385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed997d-0363-4d92-bd54-3a891f8b5d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:28.544016 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed997d-0363-4d92-bd54-3a891f8b5d0c None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:28.544303 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed997d-0363-4d92-bd54-3a891f8b5d0c None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:28.544618 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed997d-0363-4d92-bd54-3a891f8b5d0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:28.545362 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed997d-0363-4d92-bd54-3a891f8b5d0c None admin] RBAC: Adding query filter params (role.id=eaf433778e9e4d44bf6d1a1ea65d983f, scope.project.id=1cba8bf5387546e18ca3f132b9f78bc1, user.id=20953f4ef7cb44fe9392681065db4996) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:28.545684 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed997d-0363-4d92-bd54-3a891f8b5d0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:28.547781 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed997d-0363-4d92-bd54-3a891f8b5d0c None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:28.558109 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 51/92] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:50:28 2022] GET /identity/v3/role_assignments?user.id=20953f4ef7cb44fe9392681065db4996&scope.project.id=1cba8bf5387546e18ca3f132b9f78bc1&role.id=eaf433778e9e4d44bf6d1a1ea65d983f => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:28.559262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed997d-0363-4d92-bd54-3a891f8b5d0c None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:28.597301 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5eb929-38bb-4855-98ec-130780b84cbd None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:28.635837 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b45b7e-8211-45b4-b605-768d7166e5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:28.636820 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b45b7e-8211-45b4-b605-768d7166e5f3 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:28.637247 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b45b7e-8211-45b4-b605-768d7166e5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:28.637672 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b45b7e-8211-45b4-b605-768d7166e5f3 None admin] PATH_INFO: `/v3/users/20953f4ef7cb44fe9392681065db4996` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:28.639063 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b45b7e-8211-45b4-b605-768d7166e5f3 None admin] RBAC: Authorizing `identity:get_user(user_id=20953f4ef7cb44fe9392681065db4996)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:28.640783 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b45b7e-8211-45b4-b605-768d7166e5f3 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:28.642640 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 42/93] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:28 2022] GET /identity/v3/users/20953f4ef7cb44fe9392681065db4996 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:28.649605 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b45b7e-8211-45b4-b605-768d7166e5f3 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:28.656845 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:28.681005 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed997d-0363-4d92-bd54-3a891f8b5d0c None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:28.744950 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:28.765119 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee18ac7-3c43-4b70-a99b-454a281e7751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:28.765119 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee18ac7-3c43-4b70-a99b-454a281e7751 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:28.765119 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee18ac7-3c43-4b70-a99b-454a281e7751 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:28.765119 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee18ac7-3c43-4b70-a99b-454a281e7751 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:28.765566 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee18ac7-3c43-4b70-a99b-454a281e7751 None admin] RBAC: Adding query filter params (role.id=e154509f216e4ae59f74044aa234ddde, scope.project.id=1cba8bf5387546e18ca3f132b9f78bc1, user.id=3297fc4b647c4c1aa4dde010a58c50d8) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:28.765566 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee18ac7-3c43-4b70-a99b-454a281e7751 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:28.767148 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee18ac7-3c43-4b70-a99b-454a281e7751 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:28.784358 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 52/94] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:50:28 2022] GET /identity/v3/role_assignments?user.id=3297fc4b647c4c1aa4dde010a58c50d8&scope.project.id=1cba8bf5387546e18ca3f132b9f78bc1&role.id=e154509f216e4ae59f74044aa234ddde => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:28.939888 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b45b7e-8211-45b4-b605-768d7166e5f3 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:29.025411 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c12d36-d013-44cb-9dbf-ef16cfabcd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:29.025978 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c12d36-d013-44cb-9dbf-ef16cfabcd96 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:29.026263 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c12d36-d013-44cb-9dbf-ef16cfabcd96 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:29.026544 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c12d36-d013-44cb-9dbf-ef16cfabcd96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:29.202336 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c12d36-d013-44cb-9dbf-ef16cfabcd96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:29.209445 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c12d36-d013-44cb-9dbf-ef16cfabcd96 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:29.221707 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:29.426507 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 43/95] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:50:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 777 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:50:29.435462 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee18ac7-3c43-4b70-a99b-454a281e7751 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:29.585253 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee18ac7-3c43-4b70-a99b-454a281e7751 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:29.633337 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26910e-c6f0-4e5d-b18e-5621dffddc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:29.634247 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26910e-c6f0-4e5d-b18e-5621dffddc5d None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:29.634675 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26910e-c6f0-4e5d-b18e-5621dffddc5d None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:29.635093 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26910e-c6f0-4e5d-b18e-5621dffddc5d None admin] PATH_INFO: `/v3/projects/75c3048c48344e7f81d0925abaa66a90` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:29.637626 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26910e-c6f0-4e5d-b18e-5621dffddc5d None admin] RBAC: Authorizing `identity:get_project(project_id=75c3048c48344e7f81d0925abaa66a90)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:29.639253 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26910e-c6f0-4e5d-b18e-5621dffddc5d None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:29.641652 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 53/96] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:50:29 2022] GET /identity/v3/projects/75c3048c48344e7f81d0925abaa66a90 => generated 312 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:29.647910 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c12d36-d013-44cb-9dbf-ef16cfabcd96 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:29.778289 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c12d36-d013-44cb-9dbf-ef16cfabcd96 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:29.780120 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:29.825291 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b80fa7-b50a-4898-9adb-9c44b2fe4f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:29.825904 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b80fa7-b50a-4898-9adb-9c44b2fe4f26 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:29.826186 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b80fa7-b50a-4898-9adb-9c44b2fe4f26 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:29.826463 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b80fa7-b50a-4898-9adb-9c44b2fe4f26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:29.827186 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b80fa7-b50a-4898-9adb-9c44b2fe4f26 None admin] RBAC: Adding query filter params (role.id=eaf433778e9e4d44bf6d1a1ea65d983f, scope.project.id=75c3048c48344e7f81d0925abaa66a90, user.id=20953f4ef7cb44fe9392681065db4996) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:29.828028 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b80fa7-b50a-4898-9adb-9c44b2fe4f26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:29.829573 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b80fa7-b50a-4898-9adb-9c44b2fe4f26 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:29.835456 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 44/97] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:50:29 2022] GET /identity/v3/role_assignments?user.id=20953f4ef7cb44fe9392681065db4996&scope.project.id=75c3048c48344e7f81d0925abaa66a90&role.id=eaf433778e9e4d44bf6d1a1ea65d983f => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:31.287187 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d5c48-33f4-4ddc-8207-252fb606a1e3 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:31.288294 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d5c48-33f4-4ddc-8207-252fb606a1e3 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:31.288853 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d5c48-33f4-4ddc-8207-252fb606a1e3 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:31.290405 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 54/98] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:31.295768 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b85fb1-e9ce-4722-b091-113418420b34 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:31.296171 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b85fb1-e9ce-4722-b091-113418420b34 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:31.296332 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b85fb1-e9ce-4722-b091-113418420b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:31.321423 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-a8b85fb1-e9ce-4722-b091-113418420b34 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:31.322839 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-a8b85fb1-e9ce-4722-b091-113418420b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:31.404883 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 45/99] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:31.675632 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4a6e5-51bd-4b59-b9d5-d2e6ceb095a3 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:31.676346 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4a6e5-51bd-4b59-b9d5-d2e6ceb095a3 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:31.676905 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4a6e5-51bd-4b59-b9d5-d2e6ceb095a3 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:31.678525 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 55/100] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:31.684450 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c294f-7b11-4d6e-8823-0237ee4fe357 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:31.684982 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c294f-7b11-4d6e-8823-0237ee4fe357 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:31.685400 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c294f-7b11-4d6e-8823-0237ee4fe357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:31.707889 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-dc7c294f-7b11-4d6e-8823-0237ee4fe357 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:31.709337 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-dc7c294f-7b11-4d6e-8823-0237ee4fe357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:31.791752 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 46/101] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:31.861057 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc9792-93cc-4138-9b18-d06e3a763c32 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:31.861359 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc9792-93cc-4138-9b18-d06e3a763c32 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:31.861629 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc9792-93cc-4138-9b18-d06e3a763c32 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:31.863115 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 56/102] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:31.870304 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06175d7-de07-4f3c-97df-a8415d757204 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:31.870905 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06175d7-de07-4f3c-97df-a8415d757204 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:31.871417 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06175d7-de07-4f3c-97df-a8415d757204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:31.899649 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-c06175d7-de07-4f3c-97df-a8415d757204 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:31.901293 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-c06175d7-de07-4f3c-97df-a8415d757204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:31.928103 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:31.991698 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 47/103] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 03:50:32.019621 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc9792-93cc-4138-9b18-d06e3a763c32 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:32.105973 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:32.158034 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc9792-93cc-4138-9b18-d06e3a763c32 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:32.219613 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4e559-9a2e-41f4-a462-cbb55fd99131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:32.220171 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4e559-9a2e-41f4-a462-cbb55fd99131 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:32.220457 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4e559-9a2e-41f4-a462-cbb55fd99131 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:32.220758 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4e559-9a2e-41f4-a462-cbb55fd99131 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:32.225156 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4e559-9a2e-41f4-a462-cbb55fd99131 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:32.226652 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4e559-9a2e-41f4-a462-cbb55fd99131 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:32.228581 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 57/104] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:50:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:32.234387 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06175d7-de07-4f3c-97df-a8415d757204 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:32.250609 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed60614-043c-4cf0-9065-51b30d99536f None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:32.250609 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed60614-043c-4cf0-9065-51b30d99536f None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:32.250609 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed60614-043c-4cf0-9065-51b30d99536f None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:32.250609 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 58/105] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 03:50:32.254697 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50591311-88de-4298-8df5-8da5fee44b7a None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:32.255087 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50591311-88de-4298-8df5-8da5fee44b7a None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:32.255375 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50591311-88de-4298-8df5-8da5fee44b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:32.274665 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-50591311-88de-4298-8df5-8da5fee44b7a None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:32.275882 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-50591311-88de-4298-8df5-8da5fee44b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:32.346940 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 59/106] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 03:50:32.417905 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06175d7-de07-4f3c-97df-a8415d757204 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:32.433483 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90420f23-c36f-46fe-9595-b95d517a357f None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:32.433771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90420f23-c36f-46fe-9595-b95d517a357f None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:32.434055 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90420f23-c36f-46fe-9595-b95d517a357f None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:32.435593 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 60/107] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 03:50:32.440735 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d805ff-da7f-4e17-94d2-82c6470965df None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:32.441074 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d805ff-da7f-4e17-94d2-82c6470965df None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:32.441361 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d805ff-da7f-4e17-94d2-82c6470965df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:32.466622 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccee93-0b20-4bd9-a16a-ec8b4abaf7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:32.467247 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccee93-0b20-4bd9-a16a-ec8b4abaf7f0 None admin] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:32.468103 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccee93-0b20-4bd9-a16a-ec8b4abaf7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:32.468391 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccee93-0b20-4bd9-a16a-ec8b4abaf7f0 None admin] PATH_INFO: `/v3/projects` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:32.469078 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fccee93-0b20-4bd9-a16a-ec8b4abaf7f0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:32.470586 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fccee93-0b20-4bd9-a16a-ec8b4abaf7f0 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:32.473371 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-07d805ff-da7f-4e17-94d2-82c6470965df None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:32.474624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-07d805ff-da7f-4e17-94d2-82c6470965df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:32.519731 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 48/108] 10.222.0.43 () {60 vars in 1141 bytes} [Fri Aug 19 03:50:32 2022] POST /identity/v3/projects => generated 302 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:50:32.520607 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccee93-0b20-4bd9-a16a-ec8b4abaf7f0 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:32.538949 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:32.591512 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:32.613077 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 61/109] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:32.619824 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d805ff-da7f-4e17-94d2-82c6470965df None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:32.740658 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccee93-0b20-4bd9-a16a-ec8b4abaf7f0 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:32.803840 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a931b52-28cd-4970-8133-944f92328f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:32.804861 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a931b52-28cd-4970-8133-944f92328f7b None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:32.805387 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a931b52-28cd-4970-8133-944f92328f7b None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:32.805883 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a931b52-28cd-4970-8133-944f92328f7b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:32.814802 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d805ff-da7f-4e17-94d2-82c6470965df None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:32.818187 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a931b52-28cd-4970-8133-944f92328f7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:32.823516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-2a931b52-28cd-4970-8133-944f92328f7b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 03:50:32.823516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:32.823516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:32.823516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:32.823516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:32.823516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:32.823516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:32.823516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:32.823516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:32.823516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:32.823516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:32.823516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:32.823516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:32.823516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:32.823516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:32.823516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:32.824412 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:32.824412 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:32.824412 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:32.824412 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:32.824412 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:32.824412 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:32.824412 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:32.824412 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:32.824412 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:32.824412 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:32.824412 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:32.824412 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:32.824412 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:32.824412 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:32.824412 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:32.824412 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:32.825253 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:32.825253 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:32.825253 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:32.825253 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:32.825253 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:32.825253 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:32.825253 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:32.825253 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:32.825253 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:32.825253 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:32.825253 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 03:50:32.825253 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:50:32.825253 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 49/110] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 03:50:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:50:32.826383 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a931b52-28cd-4970-8133-944f92328f7b None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:32.865714 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f3822-9b28-48c6-bcb5-25a244c29ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:32.866792 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f3822-9b28-48c6-bcb5-25a244c29ee8 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:32.867294 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f3822-9b28-48c6-bcb5-25a244c29ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:32.867780 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f3822-9b28-48c6-bcb5-25a244c29ee8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:32.879518 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f3822-9b28-48c6-bcb5-25a244c29ee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:32.884928 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-c70f3822-9b28-48c6-bcb5-25a244c29ee8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 03:50:32.884928 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:32.884928 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:32.884928 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:32.884928 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:32.884928 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:32.884928 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:32.884928 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:32.884928 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:32.884928 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:32.884928 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:32.884928 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:32.884928 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:32.884928 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:32.884928 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:32.884928 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:32.885790 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:32.885790 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:32.885790 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:32.885790 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:32.885790 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:32.885790 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:32.885790 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:32.885790 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:32.885790 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:32.885790 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:32.885790 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:32.885790 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:32.885790 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:32.885790 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:32.885790 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:32.885790 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:32.886643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:32.886643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:32.886643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:32.886643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:32.886643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:32.886643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:32.886643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:32.886643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:32.886643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:32.886643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:32.886643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 03:50:32.886643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:50:32.888987 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 62/111] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:50:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:50:32.890635 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f3822-9b28-48c6-bcb5-25a244c29ee8 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:32.906668 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:32.951036 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a931b52-28cd-4970-8133-944f92328f7b None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:32.955685 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:33.002164 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7066300-4c47-4d46-a4d2-427d4dac9afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:33.003156 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7066300-4c47-4d46-a4d2-427d4dac9afc None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:33.003448 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7066300-4c47-4d46-a4d2-427d4dac9afc None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:33.003734 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7066300-4c47-4d46-a4d2-427d4dac9afc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:33.013441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f3822-9b28-48c6-bcb5-25a244c29ee8 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:33.024943 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7066300-4c47-4d46-a4d2-427d4dac9afc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:33.032516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-e7066300-4c47-4d46-a4d2-427d4dac9afc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:50:33.032516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:33.032516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:33.032516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:33.032516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:33.032516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:33.032516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:33.032516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:33.032516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:33.032516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:33.032516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:33.032516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:33.032516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:33.032516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:33.032516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:33.032516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:33.033398 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:33.033398 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:33.033398 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:33.033398 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:33.033398 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:33.033398 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:33.033398 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:33.033398 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:33.033398 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:33.033398 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:33.033398 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:33.033398 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:33.033398 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:33.033398 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:33.033398 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:33.033398 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:33.034184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:33.034184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:33.034184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:33.034184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:33.034184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:33.034184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:33.034184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:33.034184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:33.034184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:33.034184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:33.034184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:50:33.034184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:50:33.034184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 50/112] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 03:50:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:50:33.034184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7066300-4c47-4d46-a4d2-427d4dac9afc None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:33.066218 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43bb70-2016-4416-b70b-ff7c5d415d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:33.067146 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43bb70-2016-4416-b70b-ff7c5d415d8f None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:33.067695 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43bb70-2016-4416-b70b-ff7c5d415d8f None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:33.067984 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43bb70-2016-4416-b70b-ff7c5d415d8f None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:33.068689 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43bb70-2016-4416-b70b-ff7c5d415d8f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:33.068999 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43bb70-2016-4416-b70b-ff7c5d415d8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:33.070636 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43bb70-2016-4416-b70b-ff7c5d415d8f None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:33.082226 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 63/113] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:50:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:33.083113 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43bb70-2016-4416-b70b-ff7c5d415d8f None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:33.143954 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7066300-4c47-4d46-a4d2-427d4dac9afc None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:33.186967 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:33.196951 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f837dde-763b-4d02-a637-546d3e867d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:33.197856 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f837dde-763b-4d02-a637-546d3e867d30 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:33.198364 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f837dde-763b-4d02-a637-546d3e867d30 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:33.198818 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f837dde-763b-4d02-a637-546d3e867d30 None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:33.199656 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f837dde-763b-4d02-a637-546d3e867d30 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:33.200163 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f837dde-763b-4d02-a637-546d3e867d30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:33.202337 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f837dde-763b-4d02-a637-546d3e867d30 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:33.212419 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 51/114] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 03:50:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:33.213490 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f837dde-763b-4d02-a637-546d3e867d30 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:33.227817 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43bb70-2016-4416-b70b-ff7c5d415d8f None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:33.247612 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:33.275820 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217b96b-dade-4d88-88eb-0477532440a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:33.277003 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217b96b-dade-4d88-88eb-0477532440a3 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:33.277364 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217b96b-dade-4d88-88eb-0477532440a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:33.277755 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217b96b-dade-4d88-88eb-0477532440a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:33.292672 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217b96b-dade-4d88-88eb-0477532440a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:33.298778 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-0217b96b-dade-4d88-88eb-0477532440a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:50:33.298778 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:33.298778 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:33.298778 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:33.298778 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:33.298778 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:33.298778 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:33.298778 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:33.298778 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:33.298778 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:33.298778 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:33.298778 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:33.298778 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:33.298778 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:33.298778 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:33.298778 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:33.301348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:33.301348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:33.301348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:33.301348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:33.301348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:33.301348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:33.301348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:33.301348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:33.301348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:33.301348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:33.301348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:33.301348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:33.301348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:33.301348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:33.301348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:33.301348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:33.303519 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:33.303519 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:33.303519 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:33.303519 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:33.303519 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:33.303519 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:33.303519 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:33.303519 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:33.303519 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:33.303519 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:33.303519 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:50:33.303519 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:50:33.303519 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 64/115] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:50:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:50:33.305227 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217b96b-dade-4d88-88eb-0477532440a3 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:33.335435 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f837dde-763b-4d02-a637-546d3e867d30 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:33.372615 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb2292-9472-44a3-9757-71e8d678120e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:33.373228 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb2292-9472-44a3-9757-71e8d678120e None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:33.374841 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb2292-9472-44a3-9757-71e8d678120e None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:33.374841 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb2292-9472-44a3-9757-71e8d678120e None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:33.375006 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb2292-9472-44a3-9757-71e8d678120e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:33.375253 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb2292-9472-44a3-9757-71e8d678120e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:33.376672 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb2292-9472-44a3-9757-71e8d678120e None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:33.385099 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 52/116] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:50:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:33.390940 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb2292-9472-44a3-9757-71e8d678120e None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:33.410770 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217b96b-dade-4d88-88eb-0477532440a3 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:33.443679 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:33.447082 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a13f5-d8e4-4a9f-8286-0d03de6be5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:33.447724 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a13f5-d8e4-4a9f-8286-0d03de6be5d6 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:33.448010 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a13f5-d8e4-4a9f-8286-0d03de6be5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:33.448288 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a13f5-d8e4-4a9f-8286-0d03de6be5d6 None admin] PATH_INFO: `/v3/users/20953f4ef7cb44fe9392681065db4996` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:33.449468 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a13f5-d8e4-4a9f-8286-0d03de6be5d6 None admin] RBAC: Authorizing `identity:get_user(user_id=20953f4ef7cb44fe9392681065db4996)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:33.450943 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a13f5-d8e4-4a9f-8286-0d03de6be5d6 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:33.452561 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 65/117] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:33 2022] GET /identity/v3/users/20953f4ef7cb44fe9392681065db4996 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:33.453681 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bbead-73aa-4200-b5b5-370cab23701c None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:33.453966 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bbead-73aa-4200-b5b5-370cab23701c None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:33.454244 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bbead-73aa-4200-b5b5-370cab23701c None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:33.455583 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 66/118] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:33.457245 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bbead-73aa-4200-b5b5-370cab23701c None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:33.501944 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb2292-9472-44a3-9757-71e8d678120e None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:33.506517 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:33.538415 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4bb2f-0f02-489c-a2b4-b7fdbde47d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:33.538973 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4bb2f-0f02-489c-a2b4-b7fdbde47d2d None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:33.539258 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4bb2f-0f02-489c-a2b4-b7fdbde47d2d None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:33.539537 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4bb2f-0f02-489c-a2b4-b7fdbde47d2d None admin] PATH_INFO: `/v3/users/73e660e8042d4b03aeaec4bb686d9d24` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:33.555999 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4bb2f-0f02-489c-a2b4-b7fdbde47d2d None admin] RBAC: Authorizing `identity:get_user(user_id=73e660e8042d4b03aeaec4bb686d9d24)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:33.557661 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4bb2f-0f02-489c-a2b4-b7fdbde47d2d None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:33.559552 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 53/119] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:33 2022] GET /identity/v3/users/73e660e8042d4b03aeaec4bb686d9d24 => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:33.560204 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4bb2f-0f02-489c-a2b4-b7fdbde47d2d None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:33.577847 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bbead-73aa-4200-b5b5-370cab23701c None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:33.611997 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8305b-cc87-4e36-97ef-cdb6f47d4281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:33.612628 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8305b-cc87-4e36-97ef-cdb6f47d4281 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:33.612912 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8305b-cc87-4e36-97ef-cdb6f47d4281 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:33.613189 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8305b-cc87-4e36-97ef-cdb6f47d4281 None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:33.613877 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8305b-cc87-4e36-97ef-cdb6f47d4281 None admin] RBAC: Adding query filter params (name=member) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:33.614185 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8305b-cc87-4e36-97ef-cdb6f47d4281 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:33.615568 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8305b-cc87-4e36-97ef-cdb6f47d4281 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:33.628545 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 67/120] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 03:50:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:33.628545 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8305b-cc87-4e36-97ef-cdb6f47d4281 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:33.672530 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4bb2f-0f02-489c-a2b4-b7fdbde47d2d None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:33.683119 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:33.709890 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc40967-e5cc-48d5-9141-8333b16cf461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:33.710529 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc40967-e5cc-48d5-9141-8333b16cf461 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:33.710794 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc40967-e5cc-48d5-9141-8333b16cf461 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:33.711479 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc40967-e5cc-48d5-9141-8333b16cf461 None admin] PATH_INFO: `/v3/users/3297fc4b647c4c1aa4dde010a58c50d8` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:33.712639 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc40967-e5cc-48d5-9141-8333b16cf461 None admin] RBAC: Authorizing `identity:get_user(user_id=3297fc4b647c4c1aa4dde010a58c50d8)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:33.714759 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc40967-e5cc-48d5-9141-8333b16cf461 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:33.716506 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 54/121] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:33 2022] GET /identity/v3/users/3297fc4b647c4c1aa4dde010a58c50d8 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:33.717495 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467f590-c29d-49fd-9e09-980b245aefc0 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:33.717803 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467f590-c29d-49fd-9e09-980b245aefc0 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:33.718079 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467f590-c29d-49fd-9e09-980b245aefc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:33.736860 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-b467f590-c29d-49fd-9e09-980b245aefc0 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:33.738047 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-b467f590-c29d-49fd-9e09-980b245aefc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:33.741889 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8305b-cc87-4e36-97ef-cdb6f47d4281 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:33.744975 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:33.779108 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c812d8-4d86-4484-98dd-2f79bf3b7f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:33.780273 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c812d8-4d86-4484-98dd-2f79bf3b7f7e None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:33.780581 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c812d8-4d86-4484-98dd-2f79bf3b7f7e None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:33.780859 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c812d8-4d86-4484-98dd-2f79bf3b7f7e None admin] PATH_INFO: `/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:33.781997 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c812d8-4d86-4484-98dd-2f79bf3b7f7e None admin] RBAC: Authorizing `identity:get_project(project_id=1cba8bf5387546e18ca3f132b9f78bc1)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:33.783446 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c812d8-4d86-4484-98dd-2f79bf3b7f7e None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:33.790039 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 68/122] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:50:33 2022] GET /identity/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:33.790039 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c812d8-4d86-4484-98dd-2f79bf3b7f7e None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:33.824505 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 55/123] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:33.824505 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467f590-c29d-49fd-9e09-980b245aefc0 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:33.915687 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c812d8-4d86-4484-98dd-2f79bf3b7f7e None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:33.924005 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467f590-c29d-49fd-9e09-980b245aefc0 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:33.934609 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:33.962787 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1423a-a1f3-432a-9556-ea4dd7ed3ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:33.963415 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1423a-a1f3-432a-9556-ea4dd7ed3ba4 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:33.963698 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1423a-a1f3-432a-9556-ea4dd7ed3ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:33.963978 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1423a-a1f3-432a-9556-ea4dd7ed3ba4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:33.966237 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b651a-fbfa-4e40-99f4-7590ee6cf663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:33.967660 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b651a-fbfa-4e40-99f4-7590ee6cf663 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:33.968077 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b651a-fbfa-4e40-99f4-7590ee6cf663 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:33.968496 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b651a-fbfa-4e40-99f4-7590ee6cf663 None admin] PATH_INFO: `/v3/users/20953f4ef7cb44fe9392681065db4996` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:33.969648 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b651a-fbfa-4e40-99f4-7590ee6cf663 None admin] RBAC: Authorizing `identity:get_user(user_id=20953f4ef7cb44fe9392681065db4996)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:33.971100 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b651a-fbfa-4e40-99f4-7590ee6cf663 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:33.973013 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 56/124] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:33 2022] GET /identity/v3/users/20953f4ef7cb44fe9392681065db4996 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:33.973662 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b651a-fbfa-4e40-99f4-7590ee6cf663 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:34.025816 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:34.059504 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1423a-a1f3-432a-9556-ea4dd7ed3ba4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:34.060987 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1423a-a1f3-432a-9556-ea4dd7ed3ba4 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:34.090427 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b651a-fbfa-4e40-99f4-7590ee6cf663 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:34.127138 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb05bb-c491-45a3-9dbc-7ca17e57066a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:34.127772 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb05bb-c491-45a3-9dbc-7ca17e57066a None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:34.128048 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb05bb-c491-45a3-9dbc-7ca17e57066a None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:34.128324 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb05bb-c491-45a3-9dbc-7ca17e57066a None admin] PATH_INFO: `/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:34.129488 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb05bb-c491-45a3-9dbc-7ca17e57066a None admin] RBAC: Authorizing `identity:get_project(project_id=1cba8bf5387546e18ca3f132b9f78bc1)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:34.131166 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb05bb-c491-45a3-9dbc-7ca17e57066a None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:34.133055 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 57/125] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:50:33 2022] GET /identity/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:34.133750 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb05bb-c491-45a3-9dbc-7ca17e57066a None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:34.167737 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 69/126] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:50:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:50:34.168640 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1423a-a1f3-432a-9556-ea4dd7ed3ba4 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:34.183784 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:34.242489 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb05bb-c491-45a3-9dbc-7ca17e57066a None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:34.247371 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:34.279130 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0570850-65ad-4d91-8f3f-9909df53deb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:34.279904 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0570850-65ad-4d91-8f3f-9909df53deb1 None admin] REQUEST_METHOD: `PUT` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:34.280185 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0570850-65ad-4d91-8f3f-9909df53deb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:34.280462 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0570850-65ad-4d91-8f3f-9909df53deb1 None admin] PATH_INFO: `/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1/users/20953f4ef7cb44fe9392681065db4996/roles/99bf21a1487942d3be2b9bdd4483d23e` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:34.281374 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1423a-a1f3-432a-9556-ea4dd7ed3ba4 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:34.282750 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0570850-65ad-4d91-8f3f-9909df53deb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=1cba8bf5387546e18ca3f132b9f78bc1, user_id=20953f4ef7cb44fe9392681065db4996, role_id=99bf21a1487942d3be2b9bdd4483d23e)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:34.284209 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0570850-65ad-4d91-8f3f-9909df53deb1 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:34.297773 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 58/127] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 03:50:34 2022] PUT /identity/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1/users/20953f4ef7cb44fe9392681065db4996/roles/99bf21a1487942d3be2b9bdd4483d23e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 03:50:34.298332 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0570850-65ad-4d91-8f3f-9909df53deb1 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:34.323484 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1c64e-2285-4e8d-a904-e6fbbe4a823d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:34.324442 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1c64e-2285-4e8d-a904-e6fbbe4a823d None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:34.324894 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1c64e-2285-4e8d-a904-e6fbbe4a823d None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:34.325313 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1c64e-2285-4e8d-a904-e6fbbe4a823d None admin] PATH_INFO: `/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:34.326855 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1c64e-2285-4e8d-a904-e6fbbe4a823d None admin] RBAC: Authorizing `identity:get_project(project_id=1cba8bf5387546e18ca3f132b9f78bc1)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:34.328555 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1c64e-2285-4e8d-a904-e6fbbe4a823d None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:34.330555 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 70/128] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:50:34 2022] GET /identity/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:34.336895 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1c64e-2285-4e8d-a904-e6fbbe4a823d None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:34.450845 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1c64e-2285-4e8d-a904-e6fbbe4a823d None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:34.463445 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0570850-65ad-4d91-8f3f-9909df53deb1 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:34.467433 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:34.492846 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae4eec-f4f5-42a1-99be-88ece25c6e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:34.493902 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae4eec-f4f5-42a1-99be-88ece25c6e9c None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:34.494386 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae4eec-f4f5-42a1-99be-88ece25c6e9c None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:34.494884 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae4eec-f4f5-42a1-99be-88ece25c6e9c None admin] PATH_INFO: `/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:34.496279 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae4eec-f4f5-42a1-99be-88ece25c6e9c None admin] RBAC: Authorizing `identity:get_project(project_id=1cba8bf5387546e18ca3f132b9f78bc1)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:34.498096 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae4eec-f4f5-42a1-99be-88ece25c6e9c None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:34.500638 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 71/129] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:50:34 2022] GET /identity/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:34.502346 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae4eec-f4f5-42a1-99be-88ece25c6e9c None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:34.518140 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:34.521340 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4fdd82-ea96-4662-b16d-5b3e5a1ae8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:34.522091 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fdd82-ea96-4662-b16d-5b3e5a1ae8e4 None admin] REQUEST_METHOD: `PUT` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:34.522379 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fdd82-ea96-4662-b16d-5b3e5a1ae8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:34.522659 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fdd82-ea96-4662-b16d-5b3e5a1ae8e4 None admin] PATH_INFO: `/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1/users/3297fc4b647c4c1aa4dde010a58c50d8/roles/e154509f216e4ae59f74044aa234ddde` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:34.525691 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4fdd82-ea96-4662-b16d-5b3e5a1ae8e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=1cba8bf5387546e18ca3f132b9f78bc1, user_id=3297fc4b647c4c1aa4dde010a58c50d8, role_id=e154509f216e4ae59f74044aa234ddde)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:34.527553 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4fdd82-ea96-4662-b16d-5b3e5a1ae8e4 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:34.552616 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 59/130] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 03:50:34 2022] PUT /identity/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1/users/3297fc4b647c4c1aa4dde010a58c50d8/roles/e154509f216e4ae59f74044aa234ddde => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 03:50:34.560505 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4fdd82-ea96-4662-b16d-5b3e5a1ae8e4 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:34.642045 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae4eec-f4f5-42a1-99be-88ece25c6e9c None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:34.683384 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4fdd82-ea96-4662-b16d-5b3e5a1ae8e4 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:34.686396 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23798e83-0e7a-4a47-b8fc-cc5c354d7934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:34.687049 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23798e83-0e7a-4a47-b8fc-cc5c354d7934 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:34.687328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23798e83-0e7a-4a47-b8fc-cc5c354d7934 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:34.687601 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23798e83-0e7a-4a47-b8fc-cc5c354d7934 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:34.698611 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23798e83-0e7a-4a47-b8fc-cc5c354d7934 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:34.703462 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-23798e83-0e7a-4a47-b8fc-cc5c354d7934 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:50:34.703462 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:34.703462 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:34.703462 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:34.703462 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:34.703462 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:34.703462 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:34.703462 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:34.703462 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:34.703462 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:34.703462 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:34.703462 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:34.703462 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:34.703462 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:34.703462 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:34.703462 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:34.704376 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:34.704376 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:34.704376 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:34.704376 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:34.704376 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:34.704376 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:34.704376 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:34.704376 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:34.704376 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:34.704376 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:34.704376 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:34.704376 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:34.704376 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:34.704376 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:34.704376 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:34.704376 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:34.705193 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:34.705193 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:34.705193 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:34.705193 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:34.705193 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:34.705193 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:34.705193 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:34.705193 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:34.705193 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:34.705193 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:34.705193 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:50:34.705193 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:50:34.705193 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 72/131] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:50:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:50:34.705827 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23798e83-0e7a-4a47-b8fc-cc5c354d7934 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:34.732108 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb8d2c-a271-4f81-a507-6fca0a2cf4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:34.734563 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb8d2c-a271-4f81-a507-6fca0a2cf4a8 None admin] REQUEST_METHOD: `PUT` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:34.738339 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb8d2c-a271-4f81-a507-6fca0a2cf4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:34.739818 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb8d2c-a271-4f81-a507-6fca0a2cf4a8 None admin] PATH_INFO: `/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1/users/20953f4ef7cb44fe9392681065db4996/roles/eaf433778e9e4d44bf6d1a1ea65d983f` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:34.744241 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb8d2c-a271-4f81-a507-6fca0a2cf4a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=1cba8bf5387546e18ca3f132b9f78bc1, user_id=20953f4ef7cb44fe9392681065db4996, role_id=eaf433778e9e4d44bf6d1a1ea65d983f)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:34.745762 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb8d2c-a271-4f81-a507-6fca0a2cf4a8 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:34.770839 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 60/132] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 03:50:34 2022] PUT /identity/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1/users/20953f4ef7cb44fe9392681065db4996/roles/eaf433778e9e4d44bf6d1a1ea65d983f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 03:50:34.772766 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb8d2c-a271-4f81-a507-6fca0a2cf4a8 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:34.829623 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:34.838505 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:34.884928 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23798e83-0e7a-4a47-b8fc-cc5c354d7934 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:34.931351 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d858abe-b111-4ed1-bb81-2258265b1049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:34.931892 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d858abe-b111-4ed1-bb81-2258265b1049 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:34.932168 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d858abe-b111-4ed1-bb81-2258265b1049 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:34.932440 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d858abe-b111-4ed1-bb81-2258265b1049 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:34.933189 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d858abe-b111-4ed1-bb81-2258265b1049 None admin] RBAC: Adding query filter params (role.id=97127e19a070494a8ee32407f22bf958, scope.project.id=1cba8bf5387546e18ca3f132b9f78bc1, user.id=73e660e8042d4b03aeaec4bb686d9d24) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:34.933496 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d858abe-b111-4ed1-bb81-2258265b1049 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:34.934950 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d858abe-b111-4ed1-bb81-2258265b1049 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:34.944279 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 73/133] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:50:34 2022] GET /identity/v3/role_assignments?user.id=73e660e8042d4b03aeaec4bb686d9d24&scope.project.id=1cba8bf5387546e18ca3f132b9f78bc1&role.id=97127e19a070494a8ee32407f22bf958 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:34.951040 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb8d2c-a271-4f81-a507-6fca0a2cf4a8 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:34.997073 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5777a31-4724-4006-9fd4-bead693fba2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:34.997714 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5777a31-4724-4006-9fd4-bead693fba2a None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:34.998087 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5777a31-4724-4006-9fd4-bead693fba2a None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:34.998375 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5777a31-4724-4006-9fd4-bead693fba2a None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:34.999075 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5777a31-4724-4006-9fd4-bead693fba2a None admin] RBAC: Adding query filter params (name=member) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:34.999377 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5777a31-4724-4006-9fd4-bead693fba2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:35.000959 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5777a31-4724-4006-9fd4-bead693fba2a None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:35.011847 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 61/134] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 03:50:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:35.019442 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d858abe-b111-4ed1-bb81-2258265b1049 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:35.159525 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d858abe-b111-4ed1-bb81-2258265b1049 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:35.192417 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:35.199039 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c56fb4-952e-4abc-8b99-9bdc2f8dc65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:35.199702 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c56fb4-952e-4abc-8b99-9bdc2f8dc65a None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:35.200026 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c56fb4-952e-4abc-8b99-9bdc2f8dc65a None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:35.200317 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c56fb4-952e-4abc-8b99-9bdc2f8dc65a None admin] PATH_INFO: `/v3/users/20953f4ef7cb44fe9392681065db4996` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:35.202049 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c56fb4-952e-4abc-8b99-9bdc2f8dc65a None admin] RBAC: Authorizing `identity:get_user(user_id=20953f4ef7cb44fe9392681065db4996)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:35.203609 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c56fb4-952e-4abc-8b99-9bdc2f8dc65a None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:35.205519 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 74/135] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:35 2022] GET /identity/v3/users/20953f4ef7cb44fe9392681065db4996 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:50:35.210963 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5777a31-4724-4006-9fd4-bead693fba2a None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:35.324690 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:35.342088 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5777a31-4724-4006-9fd4-bead693fba2a None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:35.371193 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfecd1-6c4f-4fd2-ad59-25100660e0c0 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:35.371541 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfecd1-6c4f-4fd2-ad59-25100660e0c0 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:35.371829 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfecd1-6c4f-4fd2-ad59-25100660e0c0 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:35.374018 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 75/136] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:35.379213 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23088961-4c00-4758-b477-b35da839e58c None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:35.379500 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23088961-4c00-4758-b477-b35da839e58c None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:35.379784 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23088961-4c00-4758-b477-b35da839e58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:35.403280 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-23088961-4c00-4758-b477-b35da839e58c None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:35.404593 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-23088961-4c00-4758-b477-b35da839e58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:35.404847 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af171be-552c-4e1a-9474-445f929dcd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:35.405497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af171be-552c-4e1a-9474-445f929dcd5a None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:35.405778 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af171be-552c-4e1a-9474-445f929dcd5a None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:35.406053 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af171be-552c-4e1a-9474-445f929dcd5a None admin] PATH_INFO: `/v3/projects/75c3048c48344e7f81d0925abaa66a90` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:35.408573 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af171be-552c-4e1a-9474-445f929dcd5a None admin] RBAC: Authorizing `identity:get_project(project_id=75c3048c48344e7f81d0925abaa66a90)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:35.410036 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af171be-552c-4e1a-9474-445f929dcd5a None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:35.412022 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 62/137] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:50:35 2022] GET /identity/v3/projects/75c3048c48344e7f81d0925abaa66a90 => generated 312 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:35.419148 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af171be-552c-4e1a-9474-445f929dcd5a None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:35.528651 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 76/138] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 19 03:50:35.559698 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af171be-552c-4e1a-9474-445f929dcd5a None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:35.611003 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56c7b9-0a59-43c9-a114-a3f7a29389f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:35.611671 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56c7b9-0a59-43c9-a114-a3f7a29389f7 None admin] REQUEST_METHOD: `PUT` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:35.611993 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56c7b9-0a59-43c9-a114-a3f7a29389f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:35.612277 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56c7b9-0a59-43c9-a114-a3f7a29389f7 None admin] PATH_INFO: `/v3/projects/75c3048c48344e7f81d0925abaa66a90/users/20953f4ef7cb44fe9392681065db4996/roles/eaf433778e9e4d44bf6d1a1ea65d983f` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:35.614297 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56c7b9-0a59-43c9-a114-a3f7a29389f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=75c3048c48344e7f81d0925abaa66a90, user_id=20953f4ef7cb44fe9392681065db4996, role_id=eaf433778e9e4d44bf6d1a1ea65d983f)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:35.615791 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56c7b9-0a59-43c9-a114-a3f7a29389f7 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:35.639426 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 63/139] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 03:50:35 2022] PUT /identity/v3/projects/75c3048c48344e7f81d0925abaa66a90/users/20953f4ef7cb44fe9392681065db4996/roles/eaf433778e9e4d44bf6d1a1ea65d983f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 03:50:36.082360 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23088961-4c00-4758-b477-b35da839e58c None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:36.197455 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23088961-4c00-4758-b477-b35da839e58c None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:36.237025 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:36.243629 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75db33-728c-477a-996e-a692d47ddcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:36.244577 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75db33-728c-477a-996e-a692d47ddcfe None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:36.245074 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75db33-728c-477a-996e-a692d47ddcfe None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:36.245555 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75db33-728c-477a-996e-a692d47ddcfe None admin] PATH_INFO: `/v3/domains/default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:36.246878 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75db33-728c-477a-996e-a692d47ddcfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:36.248593 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75db33-728c-477a-996e-a692d47ddcfe None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:36.250407 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 77/140] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:50:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:36.256019 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56c7b9-0a59-43c9-a114-a3f7a29389f7 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:36.280944 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:36.391983 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56c7b9-0a59-43c9-a114-a3f7a29389f7 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:36.442176 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2b746-b696-47cf-8821-2289c5a5a743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:36.443199 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2b746-b696-47cf-8821-2289c5a5a743 None admin] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:36.443692 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2b746-b696-47cf-8821-2289c5a5a743 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:36.444179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2b746-b696-47cf-8821-2289c5a5a743 None admin] PATH_INFO: `/v3/users` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:36.445092 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2b746-b696-47cf-8821-2289c5a5a743 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:36.446816 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2b746-b696-47cf-8821-2289c5a5a743 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:36.469749 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 64/141] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 03:50:36 2022] POST /identity/v3/users => generated 283 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:50:37.207866 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ad220-e8d4-42c4-a8dd-ae6ac456c5df None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:37.208948 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ad220-e8d4-42c4-a8dd-ae6ac456c5df None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:37.209428 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ad220-e8d4-42c4-a8dd-ae6ac456c5df None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:37.211256 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 78/142] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:37.224687 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9e629-07c3-40ff-b3ac-aec44732b6e6 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:37.225757 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9e629-07c3-40ff-b3ac-aec44732b6e6 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:37.226249 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9e629-07c3-40ff-b3ac-aec44732b6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:37.252140 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-60b9e629-07c3-40ff-b3ac-aec44732b6e6 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:37.253719 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-60b9e629-07c3-40ff-b3ac-aec44732b6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:37.348860 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:37.351614 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 65/143] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 03:50:37.730651 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ad220-e8d4-42c4-a8dd-ae6ac456c5df None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:37.857336 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ad220-e8d4-42c4-a8dd-ae6ac456c5df None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:37.901035 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9fd4d-588a-4da2-a1c0-faec08573a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:37.901691 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9fd4d-588a-4da2-a1c0-faec08573a4e None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:37.901974 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9fd4d-588a-4da2-a1c0-faec08573a4e None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:37.902246 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9fd4d-588a-4da2-a1c0-faec08573a4e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:37.915796 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9fd4d-588a-4da2-a1c0-faec08573a4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:37.921288 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-37a9fd4d-588a-4da2-a1c0-faec08573a4e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 03:50:37.921288 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:37.921288 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:37.921288 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:37.921288 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:37.921288 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:37.921288 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:37.921288 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:37.921288 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:37.921288 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:37.921288 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:37.921288 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:37.921288 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:37.921288 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:37.921288 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:37.921288 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:37.922175 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:37.922175 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:37.922175 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:37.922175 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:37.922175 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:37.922175 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:37.922175 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:37.922175 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:37.922175 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:37.922175 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:37.922175 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:37.922175 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:37.922175 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:37.922175 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:37.922175 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:37.922175 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:37.922966 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:37.922966 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:37.922966 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:37.922966 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:37.922966 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:37.922966 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:37.922966 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:37.922966 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:37.922966 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:37.922966 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:37.922966 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 03:50:37.922966 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:50:37.922966 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 79/144] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 03:50:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:50:37.929949 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9e629-07c3-40ff-b3ac-aec44732b6e6 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:38.093142 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9e629-07c3-40ff-b3ac-aec44732b6e6 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:38.148601 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245baf7-01d3-48e8-8e8f-51ce0167dc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:38.149252 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245baf7-01d3-48e8-8e8f-51ce0167dc99 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:38.149540 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245baf7-01d3-48e8-8e8f-51ce0167dc99 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:38.149825 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245baf7-01d3-48e8-8e8f-51ce0167dc99 None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:38.150510 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245baf7-01d3-48e8-8e8f-51ce0167dc99 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:38.150821 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245baf7-01d3-48e8-8e8f-51ce0167dc99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:38.152216 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245baf7-01d3-48e8-8e8f-51ce0167dc99 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:38.166782 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 66/145] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:50:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:38.177718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9fd4d-588a-4da2-a1c0-faec08573a4e None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:38.226690 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe17193-0087-4fb8-8252-c3ed3dcf879d None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:38.227203 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe17193-0087-4fb8-8252-c3ed3dcf879d None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:38.227420 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe17193-0087-4fb8-8252-c3ed3dcf879d None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:38.228800 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 67/146] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 03:50:38.246039 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2e274-558b-4154-bb80-d41c007f9a7c None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:38.246346 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2e274-558b-4154-bb80-d41c007f9a7c None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:38.246593 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2e274-558b-4154-bb80-d41c007f9a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:38.273665 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:38.280387 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-99f2e274-558b-4154-bb80-d41c007f9a7c None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:38.281630 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-99f2e274-558b-4154-bb80-d41c007f9a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:38.320203 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9fd4d-588a-4da2-a1c0-faec08573a4e None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:38.358666 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:38.364875 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea781f-1feb-424d-bf5b-15616099bf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:38.365829 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea781f-1feb-424d-bf5b-15616099bf9a None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:38.365945 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea781f-1feb-424d-bf5b-15616099bf9a None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:38.366161 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea781f-1feb-424d-bf5b-15616099bf9a None admin] PATH_INFO: `/v3/users/20953f4ef7cb44fe9392681065db4996` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:38.367668 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea781f-1feb-424d-bf5b-15616099bf9a None admin] RBAC: Authorizing `identity:get_user(user_id=20953f4ef7cb44fe9392681065db4996)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:38.369217 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea781f-1feb-424d-bf5b-15616099bf9a None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:38.371033 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 80/147] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:38 2022] GET /identity/v3/users/20953f4ef7cb44fe9392681065db4996 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:38.372036 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2931c-b9d2-4313-9684-0bbc96cf8df3 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:38.372348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2931c-b9d2-4313-9684-0bbc96cf8df3 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:38.374873 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2931c-b9d2-4313-9684-0bbc96cf8df3 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:38.376316 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 81/148] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:38.376793 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 68/149] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 19 03:50:38.378579 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2931c-b9d2-4313-9684-0bbc96cf8df3 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:38.383248 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b878686-e162-4854-aef0-fd2b2efc674a None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:38.383642 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b878686-e162-4854-aef0-fd2b2efc674a None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:38.383925 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b878686-e162-4854-aef0-fd2b2efc674a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:38.412726 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-4b878686-e162-4854-aef0-fd2b2efc674a None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:38.413984 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-4b878686-e162-4854-aef0-fd2b2efc674a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:38.511480 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 69/150] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 03:50:38.530121 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5609d-254f-4616-87ad-c2832618bef5 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:38.530409 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5609d-254f-4616-87ad-c2832618bef5 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:38.530695 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5609d-254f-4616-87ad-c2832618bef5 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:38.532188 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 70/151] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:38.536403 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2931c-b9d2-4313-9684-0bbc96cf8df3 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:38.537195 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc6750-1937-49cd-a8a7-4adbb2804749 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:38.537484 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc6750-1937-49cd-a8a7-4adbb2804749 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:38.537765 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc6750-1937-49cd-a8a7-4adbb2804749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:38.563074 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-84cc6750-1937-49cd-a8a7-4adbb2804749 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:38.564683 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-84cc6750-1937-49cd-a8a7-4adbb2804749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:38.573130 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:38.585257 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b4aee-73c4-4b63-9deb-1b44e84c3077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:38.585889 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b4aee-73c4-4b63-9deb-1b44e84c3077 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:38.586175 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b4aee-73c4-4b63-9deb-1b44e84c3077 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:38.586454 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b4aee-73c4-4b63-9deb-1b44e84c3077 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:38.644979 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 71/152] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:38.706803 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b4aee-73c4-4b63-9deb-1b44e84c3077 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:38.708296 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b4aee-73c4-4b63-9deb-1b44e84c3077 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:38.819228 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 82/153] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:50:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:50:38.824661 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc6750-1937-49cd-a8a7-4adbb2804749 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:38.912038 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:38.968223 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc6750-1937-49cd-a8a7-4adbb2804749 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:39.006226 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4c5c1-9dff-4402-965d-dbd62b0e7502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:39.006891 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4c5c1-9dff-4402-965d-dbd62b0e7502 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:39.007423 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4c5c1-9dff-4402-965d-dbd62b0e7502 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:39.007778 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4c5c1-9dff-4402-965d-dbd62b0e7502 None admin] PATH_INFO: `/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:39.009047 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4c5c1-9dff-4402-965d-dbd62b0e7502 None admin] RBAC: Authorizing `identity:get_project(project_id=1cba8bf5387546e18ca3f132b9f78bc1)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:39.010570 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4c5c1-9dff-4402-965d-dbd62b0e7502 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:39.012607 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 72/154] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:50:38 2022] GET /identity/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:39.018648 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b4aee-73c4-4b63-9deb-1b44e84c3077 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:39.063459 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:39.156750 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b4aee-73c4-4b63-9deb-1b44e84c3077 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:39.192145 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd00a1-84db-40cc-a759-23927f607423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:39.192793 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd00a1-84db-40cc-a759-23927f607423 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:39.193075 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd00a1-84db-40cc-a759-23927f607423 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:39.193348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd00a1-84db-40cc-a759-23927f607423 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:39.194070 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd00a1-84db-40cc-a759-23927f607423 None admin] RBAC: Adding query filter params (role.id=99bf21a1487942d3be2b9bdd4483d23e, scope.project.id=1cba8bf5387546e18ca3f132b9f78bc1, user.id=20953f4ef7cb44fe9392681065db4996) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:39.194375 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd00a1-84db-40cc-a759-23927f607423 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:39.195995 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd00a1-84db-40cc-a759-23927f607423 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:39.202352 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 83/155] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:50:39 2022] GET /identity/v3/role_assignments?user.id=20953f4ef7cb44fe9392681065db4996&scope.project.id=1cba8bf5387546e18ca3f132b9f78bc1&role.id=99bf21a1487942d3be2b9bdd4483d23e => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:39.255503 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4c5c1-9dff-4402-965d-dbd62b0e7502 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:39.313943 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd00a1-84db-40cc-a759-23927f607423 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:39.408873 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4c5c1-9dff-4402-965d-dbd62b0e7502 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:39.435296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:39.448928 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:39.452836 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd00a1-84db-40cc-a759-23927f607423 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:39.453823 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d853f33-99a9-45ae-b011-7b4a774294c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:39.454708 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d853f33-99a9-45ae-b011-7b4a774294c2 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:39.455175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d853f33-99a9-45ae-b011-7b4a774294c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:39.455658 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d853f33-99a9-45ae-b011-7b4a774294c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:39.481497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d853f33-99a9-45ae-b011-7b4a774294c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:39.489946 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-3d853f33-99a9-45ae-b011-7b4a774294c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:50:39.489946 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:39.489946 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:39.489946 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:39.489946 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:39.489946 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:39.489946 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:39.489946 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:39.489946 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:39.489946 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:39.489946 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:39.489946 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:39.489946 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:39.489946 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:39.489946 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:39.489946 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:39.490897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:39.490897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:39.490897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:39.490897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:39.490897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:39.490897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:39.490897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:39.490897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:39.490897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:39.490897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:39.490897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:39.490897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:39.490897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:39.490897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:39.490897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:39.490897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:39.491687 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:39.491687 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:39.491687 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:39.491687 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:39.491687 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:39.491687 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:39.491687 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:39.491687 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:39.491687 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:39.491687 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:39.491687 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:50:39.491687 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:50:39.497415 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 73/156] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 03:50:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:50:39.498624 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cef8a-ece7-4558-8ce4-804516ce74d7 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:39.498908 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cef8a-ece7-4558-8ce4-804516ce74d7 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:39.499183 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cef8a-ece7-4558-8ce4-804516ce74d7 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:39.504878 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 74/157] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:39.505845 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cef8a-ece7-4558-8ce4-804516ce74d7 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:39.542958 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f80807-84cd-4e2f-b407-acc1d291b07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:39.543607 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f80807-84cd-4e2f-b407-acc1d291b07b None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:39.543918 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f80807-84cd-4e2f-b407-acc1d291b07b None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:39.544199 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f80807-84cd-4e2f-b407-acc1d291b07b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:39.564575 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f80807-84cd-4e2f-b407-acc1d291b07b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:39.570309 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-49f80807-84cd-4e2f-b407-acc1d291b07b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 03:50:39.570309 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:39.570309 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:39.570309 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:39.570309 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:39.570309 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:39.570309 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:39.570309 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:39.570309 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:39.570309 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:39.570309 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:39.570309 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:39.570309 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:39.570309 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:39.570309 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:39.570309 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:39.571978 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:39.571978 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:39.571978 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:39.571978 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:39.571978 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:39.571978 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:39.571978 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:39.571978 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:39.571978 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:39.571978 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:39.571978 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:39.571978 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:39.571978 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:39.571978 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:39.571978 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:39.571978 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:39.574761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:39.574761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:39.574761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:39.574761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:39.574761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:39.574761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:39.574761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:39.574761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:39.574761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:39.574761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:39.574761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 03:50:39.574761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:50:39.574761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 84/158] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:50:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 03:50:39.580696 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d19cf-8104-418d-899d-4af64e65c63c None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:39.580696 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d19cf-8104-418d-899d-4af64e65c63c None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:39.580696 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d19cf-8104-418d-899d-4af64e65c63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:39.610738 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-200d19cf-8104-418d-899d-4af64e65c63c None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:39.611921 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-200d19cf-8104-418d-899d-4af64e65c63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:39.711520 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cef8a-ece7-4558-8ce4-804516ce74d7 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:39.730073 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 85/159] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:39.730752 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d19cf-8104-418d-899d-4af64e65c63c None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:39.807665 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84fbaf-8b66-43c8-a4ae-d492ffa501c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:39.808380 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84fbaf-8b66-43c8-a4ae-d492ffa501c5 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:39.808701 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84fbaf-8b66-43c8-a4ae-d492ffa501c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:39.808982 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84fbaf-8b66-43c8-a4ae-d492ffa501c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:39.828843 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:39.848924 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84fbaf-8b66-43c8-a4ae-d492ffa501c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:39.849470 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d19cf-8104-418d-899d-4af64e65c63c None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:39.854137 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-9a84fbaf-8b66-43c8-a4ae-d492ffa501c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:50:39.854137 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:39.854137 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:39.854137 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:39.854137 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:39.854137 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:39.854137 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:39.854137 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:39.854137 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:39.854137 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:39.854137 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:39.854137 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:39.854137 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:39.854137 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:39.854137 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:39.854137 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:39.855022 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:39.855022 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:39.855022 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:39.855022 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:39.855022 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:39.855022 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:39.855022 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:39.855022 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:39.855022 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:39.855022 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:39.855022 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:39.855022 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:39.855022 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:39.855022 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:39.855022 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:39.855022 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:39.855897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:39.855897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:39.855897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:39.855897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:39.855897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:39.855897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:39.855897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:39.855897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:39.855897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:39.855897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:39.855897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:50:39.855897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:50:39.855897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 75/160] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:50:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:50:39.856626 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84fbaf-8b66-43c8-a4ae-d492ffa501c5 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:39.920529 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09adc6e-eb3c-499e-af4c-16e9a655c5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:39.921214 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09adc6e-eb3c-499e-af4c-16e9a655c5c0 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:39.921496 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09adc6e-eb3c-499e-af4c-16e9a655c5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:39.921770 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09adc6e-eb3c-499e-af4c-16e9a655c5c0 None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:39.922442 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09adc6e-eb3c-499e-af4c-16e9a655c5c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:39.922802 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09adc6e-eb3c-499e-af4c-16e9a655c5c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:39.924195 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09adc6e-eb3c-499e-af4c-16e9a655c5c0 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:39.938764 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 86/161] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:50:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:39.939506 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09adc6e-eb3c-499e-af4c-16e9a655c5c0 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:39.964915 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:40.176857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09adc6e-eb3c-499e-af4c-16e9a655c5c0 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:40.178407 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84fbaf-8b66-43c8-a4ae-d492ffa501c5 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:40.235835 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4ddf1-959c-44d7-90b8-c18860efe268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:40.236367 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4ddf1-959c-44d7-90b8-c18860efe268 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:40.236672 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4ddf1-959c-44d7-90b8-c18860efe268 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:40.236946 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4ddf1-959c-44d7-90b8-c18860efe268 None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:40.237595 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4ddf1-959c-44d7-90b8-c18860efe268 None admin] RBAC: Adding query filter params (name=member) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:40.237894 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4ddf1-959c-44d7-90b8-c18860efe268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:40.239279 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4ddf1-959c-44d7-90b8-c18860efe268 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:40.250006 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 87/162] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 03:50:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:40.251475 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4ddf1-959c-44d7-90b8-c18860efe268 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:40.265342 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:40.273187 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753030e-4169-45f3-a20e-4180ecffad4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:40.273905 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753030e-4169-45f3-a20e-4180ecffad4f None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:40.274097 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753030e-4169-45f3-a20e-4180ecffad4f None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:40.274379 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753030e-4169-45f3-a20e-4180ecffad4f None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:40.275061 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753030e-4169-45f3-a20e-4180ecffad4f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:40.275365 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753030e-4169-45f3-a20e-4180ecffad4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:40.276796 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753030e-4169-45f3-a20e-4180ecffad4f None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:40.302562 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 76/163] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 03:50:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:40.303244 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753030e-4169-45f3-a20e-4180ecffad4f None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:40.394262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4ddf1-959c-44d7-90b8-c18860efe268 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:40.463802 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f6038-2724-4495-a1ee-aab53be7793e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:40.464867 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f6038-2724-4495-a1ee-aab53be7793e None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:40.465351 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f6038-2724-4495-a1ee-aab53be7793e None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:40.465898 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f6038-2724-4495-a1ee-aab53be7793e None admin] PATH_INFO: `/v3/users/3297fc4b647c4c1aa4dde010a58c50d8` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:40.468755 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f6038-2724-4495-a1ee-aab53be7793e None admin] RBAC: Authorizing `identity:get_user(user_id=3297fc4b647c4c1aa4dde010a58c50d8)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:40.470408 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f6038-2724-4495-a1ee-aab53be7793e None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:40.473003 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 88/164] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:40 2022] GET /identity/v3/users/3297fc4b647c4c1aa4dde010a58c50d8 => generated 247 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:40.476921 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f6038-2724-4495-a1ee-aab53be7793e None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:40.506096 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753030e-4169-45f3-a20e-4180ecffad4f None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:40.520793 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:40.556143 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f233c9d-f7df-41c7-98a9-12fbffe793e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:40.556859 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f233c9d-f7df-41c7-98a9-12fbffe793e1 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:40.557140 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f233c9d-f7df-41c7-98a9-12fbffe793e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:40.557418 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f233c9d-f7df-41c7-98a9-12fbffe793e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:40.567901 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f233c9d-f7df-41c7-98a9-12fbffe793e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:40.573149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-7f233c9d-f7df-41c7-98a9-12fbffe793e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:50:40.573149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:40.573149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:40.573149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:40.573149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:40.573149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:40.573149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:40.573149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:40.573149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:40.573149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:40.573149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:40.573149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:40.573149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:40.573149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:40.573149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:40.573149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:40.574179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:40.574179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:40.574179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:40.574179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:40.574179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:40.574179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:40.574179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:40.574179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:40.574179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:40.574179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:40.574179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:40.574179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:40.574179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:40.574179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:40.574179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:40.574179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:40.575017 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:40.575017 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:40.575017 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:40.575017 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:40.575017 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:40.575017 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:40.575017 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:40.575017 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:40.575017 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:40.575017 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:40.575017 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:50:40.575017 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:50:40.575017 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 77/165] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:50:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:50:40.575713 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f233c9d-f7df-41c7-98a9-12fbffe793e1 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:40.613603 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:40.666781 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f6038-2724-4495-a1ee-aab53be7793e None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:40.690828 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f233c9d-f7df-41c7-98a9-12fbffe793e1 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:40.728502 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e30abd-f787-4984-b191-f05b44a54eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:40.729215 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e30abd-f787-4984-b191-f05b44a54eda None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:40.729496 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e30abd-f787-4984-b191-f05b44a54eda None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:40.729769 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e30abd-f787-4984-b191-f05b44a54eda None admin] PATH_INFO: `/v3/users/73e660e8042d4b03aeaec4bb686d9d24` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:40.730938 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e30abd-f787-4984-b191-f05b44a54eda None admin] RBAC: Authorizing `identity:get_user(user_id=73e660e8042d4b03aeaec4bb686d9d24)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:40.733195 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e30abd-f787-4984-b191-f05b44a54eda None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:40.735121 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 78/166] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:40 2022] GET /identity/v3/users/73e660e8042d4b03aeaec4bb686d9d24 => generated 289 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:40.736103 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e30abd-f787-4984-b191-f05b44a54eda None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:40.736885 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c494501-a36e-4dad-8820-7ffbcc7ea609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:40.737528 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c494501-a36e-4dad-8820-7ffbcc7ea609 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:40.737808 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c494501-a36e-4dad-8820-7ffbcc7ea609 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:40.738084 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c494501-a36e-4dad-8820-7ffbcc7ea609 None admin] PATH_INFO: `/v3/users/20953f4ef7cb44fe9392681065db4996` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:40.741281 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c494501-a36e-4dad-8820-7ffbcc7ea609 None admin] RBAC: Authorizing `identity:get_user(user_id=20953f4ef7cb44fe9392681065db4996)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:40.742755 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c494501-a36e-4dad-8820-7ffbcc7ea609 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:40.744359 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 89/167] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:40 2022] GET /identity/v3/users/20953f4ef7cb44fe9392681065db4996 => generated 275 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:40.745156 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c494501-a36e-4dad-8820-7ffbcc7ea609 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:40.793666 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:40.845526 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e30abd-f787-4984-b191-f05b44a54eda None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:40.881119 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf30058-0d44-4e38-bfa3-d80410c251fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:40.881725 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf30058-0d44-4e38-bfa3-d80410c251fc None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:40.881998 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf30058-0d44-4e38-bfa3-d80410c251fc None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:40.882272 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf30058-0d44-4e38-bfa3-d80410c251fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:40.894889 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c494501-a36e-4dad-8820-7ffbcc7ea609 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:40.940632 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690efe12-62f2-4f9f-89ba-fe67e9ccd49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:40.941798 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690efe12-62f2-4f9f-89ba-fe67e9ccd49e None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:40.942276 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690efe12-62f2-4f9f-89ba-fe67e9ccd49e None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:40.942903 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690efe12-62f2-4f9f-89ba-fe67e9ccd49e None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:40.944158 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690efe12-62f2-4f9f-89ba-fe67e9ccd49e None admin] RBAC: Adding query filter params (name=member) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:40.944918 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690efe12-62f2-4f9f-89ba-fe67e9ccd49e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:40.947126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690efe12-62f2-4f9f-89ba-fe67e9ccd49e None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:40.959125 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf30058-0d44-4e38-bfa3-d80410c251fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:40.960750 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf30058-0d44-4e38-bfa3-d80410c251fc None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:40.960977 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 90/168] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 03:50:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:40.961993 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690efe12-62f2-4f9f-89ba-fe67e9ccd49e None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:40.965097 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:40.997617 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:41.086141 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 79/169] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:50:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:50:41.087519 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf30058-0d44-4e38-bfa3-d80410c251fc None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:41.092535 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690efe12-62f2-4f9f-89ba-fe67e9ccd49e None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:41.138400 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c2c95-41ae-46d2-b44c-54b4afa0bab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:41.139049 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c2c95-41ae-46d2-b44c-54b4afa0bab7 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:41.139326 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c2c95-41ae-46d2-b44c-54b4afa0bab7 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:41.139597 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c2c95-41ae-46d2-b44c-54b4afa0bab7 None admin] PATH_INFO: `/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:41.141035 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c2c95-41ae-46d2-b44c-54b4afa0bab7 None admin] RBAC: Authorizing `identity:get_project(project_id=1cba8bf5387546e18ca3f132b9f78bc1)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:41.142756 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c2c95-41ae-46d2-b44c-54b4afa0bab7 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:41.144813 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 91/170] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:50:40 2022] GET /identity/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:41.146355 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750bf7a-41da-4308-8818-18148dbcf728 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:41.146642 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750bf7a-41da-4308-8818-18148dbcf728 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:41.146916 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750bf7a-41da-4308-8818-18148dbcf728 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:41.148247 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 92/171] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:41.149014 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750bf7a-41da-4308-8818-18148dbcf728 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:41.202008 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf30058-0d44-4e38-bfa3-d80410c251fc None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:41.227138 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:41.233363 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:41.239731 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2f365-5c8c-4326-9f01-40c79e9f66c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:41.240505 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2f365-5c8c-4326-9f01-40c79e9f66c1 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:41.241145 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2f365-5c8c-4326-9f01-40c79e9f66c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:41.241145 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2f365-5c8c-4326-9f01-40c79e9f66c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:41.267351 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750bf7a-41da-4308-8818-18148dbcf728 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:41.305831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b736f-06f2-4ab1-a424-c5f6b780781d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:41.306486 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b736f-06f2-4ab1-a424-c5f6b780781d None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:41.306763 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b736f-06f2-4ab1-a424-c5f6b780781d None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:41.307153 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b736f-06f2-4ab1-a424-c5f6b780781d None admin] PATH_INFO: `/v3/users/20953f4ef7cb44fe9392681065db4996` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:41.309016 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b736f-06f2-4ab1-a424-c5f6b780781d None admin] RBAC: Authorizing `identity:get_user(user_id=20953f4ef7cb44fe9392681065db4996)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:41.310516 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b736f-06f2-4ab1-a424-c5f6b780781d None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:41.312056 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 93/172] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:41 2022] GET /identity/v3/users/20953f4ef7cb44fe9392681065db4996 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:41.316575 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b736f-06f2-4ab1-a424-c5f6b780781d None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:41.320781 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2f365-5c8c-4326-9f01-40c79e9f66c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:41.322245 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2f365-5c8c-4326-9f01-40c79e9f66c1 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:41.420086 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b736f-06f2-4ab1-a424-c5f6b780781d None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:41.432744 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 80/173] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:50:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:50:41.432744 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2f365-5c8c-4326-9f01-40c79e9f66c1 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:41.459263 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96e905-c69b-46fd-89ea-ff4a0435c4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:41.459896 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96e905-c69b-46fd-89ea-ff4a0435c4ba None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:41.460169 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96e905-c69b-46fd-89ea-ff4a0435c4ba None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:41.460443 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96e905-c69b-46fd-89ea-ff4a0435c4ba None admin] PATH_INFO: `/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:41.461573 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96e905-c69b-46fd-89ea-ff4a0435c4ba None admin] RBAC: Authorizing `identity:get_project(project_id=1cba8bf5387546e18ca3f132b9f78bc1)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:41.462965 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:41.463078 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96e905-c69b-46fd-89ea-ff4a0435c4ba None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:41.465041 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 94/174] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:50:41 2022] GET /identity/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:41.466713 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e9b2c-edd9-4f40-91a6-81f9714c0ae6 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:41.467044 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e9b2c-edd9-4f40-91a6-81f9714c0ae6 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:41.467247 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e9b2c-edd9-4f40-91a6-81f9714c0ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:41.480095 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:41.486905 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-729e9b2c-edd9-4f40-91a6-81f9714c0ae6 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:41.488078 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-729e9b2c-edd9-4f40-91a6-81f9714c0ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:41.546424 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2f365-5c8c-4326-9f01-40c79e9f66c1 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:41.560647 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 95/175] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:41.562029 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a23087-2afd-4c70-ad1c-0308e9572188 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:41.562311 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a23087-2afd-4c70-ad1c-0308e9572188 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:41.562582 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a23087-2afd-4c70-ad1c-0308e9572188 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:41.568134 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 96/176] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:41.568134 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a23087-2afd-4c70-ad1c-0308e9572188 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:41.595381 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71376633-7243-47a9-bf91-063aa039f940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:41.596336 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71376633-7243-47a9-bf91-063aa039f940 None admin] REQUEST_METHOD: `PUT` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:41.596784 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71376633-7243-47a9-bf91-063aa039f940 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:41.597228 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71376633-7243-47a9-bf91-063aa039f940 None admin] PATH_INFO: `/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1/users/73e660e8042d4b03aeaec4bb686d9d24/roles/97127e19a070494a8ee32407f22bf958` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:41.599520 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71376633-7243-47a9-bf91-063aa039f940 None admin] RBAC: Authorizing `identity:create_grant(project_id=1cba8bf5387546e18ca3f132b9f78bc1, user_id=73e660e8042d4b03aeaec4bb686d9d24, role_id=97127e19a070494a8ee32407f22bf958)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:41.601273 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71376633-7243-47a9-bf91-063aa039f940 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:41.620952 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 81/177] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 03:50:41 2022] PUT /identity/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1/users/73e660e8042d4b03aeaec4bb686d9d24/roles/97127e19a070494a8ee32407f22bf958 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 03:50:41.622100 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71376633-7243-47a9-bf91-063aa039f940 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:41.693781 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a23087-2afd-4c70-ad1c-0308e9572188 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:41.739589 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7ba6e-df98-46f7-82d6-b8809ffbe3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:41.740242 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7ba6e-df98-46f7-82d6-b8809ffbe3e3 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:41.744518 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7ba6e-df98-46f7-82d6-b8809ffbe3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:41.744518 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7ba6e-df98-46f7-82d6-b8809ffbe3e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:41.750754 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:41.764878 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:41.771153 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71376633-7243-47a9-bf91-063aa039f940 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:41.818306 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395004d-494b-48f3-8721-c55f09507cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:41.819259 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395004d-494b-48f3-8721-c55f09507cdf None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:41.819831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395004d-494b-48f3-8721-c55f09507cdf None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:41.820409 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395004d-494b-48f3-8721-c55f09507cdf None admin] PATH_INFO: `/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:41.822307 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395004d-494b-48f3-8721-c55f09507cdf None admin] RBAC: Authorizing `identity:get_project(project_id=1cba8bf5387546e18ca3f132b9f78bc1)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:41.824146 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395004d-494b-48f3-8721-c55f09507cdf None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:41.826929 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 82/178] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:50:41 2022] GET /identity/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:41.828000 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395004d-494b-48f3-8721-c55f09507cdf None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:41.854884 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7ba6e-df98-46f7-82d6-b8809ffbe3e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:41.856372 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7ba6e-df98-46f7-82d6-b8809ffbe3e3 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:41.958704 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395004d-494b-48f3-8721-c55f09507cdf None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:41.970309 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 97/179] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:50:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:50:41.972118 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5385a8c-a8d1-499c-a8cd-9c6999495c9b None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:41.972621 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5385a8c-a8d1-499c-a8cd-9c6999495c9b None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:41.973103 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5385a8c-a8d1-499c-a8cd-9c6999495c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:41.991488 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-c5385a8c-a8d1-499c-a8cd-9c6999495c9b None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:41.992749 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-c5385a8c-a8d1-499c-a8cd-9c6999495c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:41.997415 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43042426-b59b-4c0c-a2a2-3bbaa12f0cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:41.998257 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43042426-b59b-4c0c-a2a2-3bbaa12f0cca None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:41.998716 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43042426-b59b-4c0c-a2a2-3bbaa12f0cca None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:41.999168 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43042426-b59b-4c0c-a2a2-3bbaa12f0cca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:42.000072 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43042426-b59b-4c0c-a2a2-3bbaa12f0cca None admin] RBAC: Adding query filter params (role.id=e154509f216e4ae59f74044aa234ddde, scope.project.id=1cba8bf5387546e18ca3f132b9f78bc1, user.id=3297fc4b647c4c1aa4dde010a58c50d8) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:42.000590 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43042426-b59b-4c0c-a2a2-3bbaa12f0cca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:42.002211 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43042426-b59b-4c0c-a2a2-3bbaa12f0cca None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:42.009222 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 83/180] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:50:41 2022] GET /identity/v3/role_assignments?user.id=3297fc4b647c4c1aa4dde010a58c50d8&scope.project.id=1cba8bf5387546e18ca3f132b9f78bc1&role.id=e154509f216e4ae59f74044aa234ddde => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:42.010747 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666efa1d-c332-4503-bf88-8ef6555b8d1c None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:42.011442 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666efa1d-c332-4503-bf88-8ef6555b8d1c None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:42.011886 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666efa1d-c332-4503-bf88-8ef6555b8d1c None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:42.018486 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 84/181] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:42.018486 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666efa1d-c332-4503-bf88-8ef6555b8d1c None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:42.034289 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:42.052563 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:42.077805 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 98/182] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:42.085878 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5385a8c-a8d1-499c-a8cd-9c6999495c9b None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:42.153341 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666efa1d-c332-4503-bf88-8ef6555b8d1c None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:42.192512 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4f661-a7ff-4018-af38-8d90f91b6591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:42.193317 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4f661-a7ff-4018-af38-8d90f91b6591 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:42.193667 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4f661-a7ff-4018-af38-8d90f91b6591 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:42.194015 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4f661-a7ff-4018-af38-8d90f91b6591 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:42.194892 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4f661-a7ff-4018-af38-8d90f91b6591 None admin] RBAC: Adding query filter params (role.id=eaf433778e9e4d44bf6d1a1ea65d983f, scope.project.id=1cba8bf5387546e18ca3f132b9f78bc1, user.id=20953f4ef7cb44fe9392681065db4996) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:42.195273 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4f661-a7ff-4018-af38-8d90f91b6591 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:42.197056 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4f661-a7ff-4018-af38-8d90f91b6591 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:42.205119 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 85/183] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:50:42 2022] GET /identity/v3/role_assignments?user.id=20953f4ef7cb44fe9392681065db4996&scope.project.id=1cba8bf5387546e18ca3f132b9f78bc1&role.id=eaf433778e9e4d44bf6d1a1ea65d983f => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:42.209906 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4f661-a7ff-4018-af38-8d90f91b6591 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:42.304582 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5385a8c-a8d1-499c-a8cd-9c6999495c9b None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:42.350938 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8521af-7812-4194-8fff-af4ed91c40dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:42.352005 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8521af-7812-4194-8fff-af4ed91c40dc None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:42.352464 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8521af-7812-4194-8fff-af4ed91c40dc None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:42.352953 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8521af-7812-4194-8fff-af4ed91c40dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:42.356358 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:42.373704 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4f661-a7ff-4018-af38-8d90f91b6591 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:42.374204 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8521af-7812-4194-8fff-af4ed91c40dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:42.386262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-9f8521af-7812-4194-8fff-af4ed91c40dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:50:42.386262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:42.386262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:42.386262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:42.386262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:42.386262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:42.386262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:42.386262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:42.386262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:42.386262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:42.386262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:42.386262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:42.386262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:42.386262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:42.386262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:42.386262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:42.387831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:42.387831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:42.387831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:42.387831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:42.387831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:42.387831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:42.387831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:42.387831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:42.387831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:42.387831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:42.387831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:42.387831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:42.387831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:42.387831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:42.387831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:42.387831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:42.388698 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:42.388698 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:42.388698 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:42.388698 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:42.388698 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:42.388698 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:42.388698 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:42.388698 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:42.388698 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:42.388698 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:42.388698 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:50:42.388698 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:50:42.395880 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 99/184] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 03:50:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:50:42.397579 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef57e7-abd9-490b-8c3b-1f870cad9c7b None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:42.398028 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef57e7-abd9-490b-8c3b-1f870cad9c7b None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:42.398445 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef57e7-abd9-490b-8c3b-1f870cad9c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:42.419401 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db96195-6ddd-4090-a199-574b58037ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:42.420185 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db96195-6ddd-4090-a199-574b58037ead None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:42.420598 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db96195-6ddd-4090-a199-574b58037ead None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:42.421162 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db96195-6ddd-4090-a199-574b58037ead None admin] PATH_INFO: `/v3/projects/75c3048c48344e7f81d0925abaa66a90` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:42.422246 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db96195-6ddd-4090-a199-574b58037ead None admin] RBAC: Authorizing `identity:get_project(project_id=75c3048c48344e7f81d0925abaa66a90)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:42.423803 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db96195-6ddd-4090-a199-574b58037ead None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:42.425605 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 86/185] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:50:42 2022] GET /identity/v3/projects/75c3048c48344e7f81d0925abaa66a90 => generated 312 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:42.432528 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db96195-6ddd-4090-a199-574b58037ead None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:42.434641 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-fbef57e7-abd9-490b-8c3b-1f870cad9c7b None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:42.436385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-fbef57e7-abd9-490b-8c3b-1f870cad9c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:42.463980 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:42.540880 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 100/186] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:42.541617 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef57e7-abd9-490b-8c3b-1f870cad9c7b None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:42.562177 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db96195-6ddd-4090-a199-574b58037ead None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:42.630805 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18a33e-b828-40dd-90b6-cc27226b4746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:42.631694 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18a33e-b828-40dd-90b6-cc27226b4746 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:42.631978 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18a33e-b828-40dd-90b6-cc27226b4746 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:42.632257 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18a33e-b828-40dd-90b6-cc27226b4746 None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:42.633047 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18a33e-b828-40dd-90b6-cc27226b4746 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:42.633361 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18a33e-b828-40dd-90b6-cc27226b4746 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:42.634749 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18a33e-b828-40dd-90b6-cc27226b4746 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:42.651199 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 87/187] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:50:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:42.651199 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18a33e-b828-40dd-90b6-cc27226b4746 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:42.677454 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:42.706183 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef57e7-abd9-490b-8c3b-1f870cad9c7b None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:42.752927 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e898773-b49d-4222-a1d9-c98638520b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:42.753818 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e898773-b49d-4222-a1d9-c98638520b3b None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:42.754235 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e898773-b49d-4222-a1d9-c98638520b3b None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:42.754655 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e898773-b49d-4222-a1d9-c98638520b3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:42.755512 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e898773-b49d-4222-a1d9-c98638520b3b None admin] RBAC: Adding query filter params (role.id=eaf433778e9e4d44bf6d1a1ea65d983f, scope.project.id=75c3048c48344e7f81d0925abaa66a90, user.id=20953f4ef7cb44fe9392681065db4996) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:42.755956 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e898773-b49d-4222-a1d9-c98638520b3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:42.757592 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e898773-b49d-4222-a1d9-c98638520b3b None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:42.765321 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 101/188] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:50:42 2022] GET /identity/v3/role_assignments?user.id=20953f4ef7cb44fe9392681065db4996&scope.project.id=75c3048c48344e7f81d0925abaa66a90&role.id=eaf433778e9e4d44bf6d1a1ea65d983f => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:42.766327 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e898773-b49d-4222-a1d9-c98638520b3b None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:42.793887 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18a33e-b828-40dd-90b6-cc27226b4746 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:42.796077 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:42.853350 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e550c15-865c-4479-9769-f09f71954a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:42.854015 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e550c15-865c-4479-9769-f09f71954a09 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:42.854297 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e550c15-865c-4479-9769-f09f71954a09 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:42.854682 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e550c15-865c-4479-9769-f09f71954a09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:42.869922 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e550c15-865c-4479-9769-f09f71954a09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:42.877836 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-0e550c15-865c-4479-9769-f09f71954a09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 03:50:42.877836 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:42.877836 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:42.877836 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:42.877836 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:42.877836 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:42.877836 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:42.877836 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:42.877836 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:42.877836 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:42.877836 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:42.877836 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:42.877836 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:42.877836 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:42.877836 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:42.877836 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:42.879028 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:42.879028 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:42.879028 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:42.879028 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:42.879028 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:42.879028 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:42.879028 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:42.879028 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:42.879028 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:42.879028 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:42.879028 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:42.879028 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:42.879028 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:42.879028 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:42.879028 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:42.879028 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:42.879865 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:42.879865 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:42.879865 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:42.879865 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:42.879865 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:42.879865 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:42.879865 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:42.879865 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:42.879865 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:42.879865 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:42.879865 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 03:50:42.879865 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:50:42.879865 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 88/189] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 03:50:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:50:42.886210 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e550c15-865c-4479-9769-f09f71954a09 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:42.904883 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e898773-b49d-4222-a1d9-c98638520b3b None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:42.958168 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1ea34-8dd1-4bac-80db-6b1b1e587bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:42.959095 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1ea34-8dd1-4bac-80db-6b1b1e587bd0 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:42.959524 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1ea34-8dd1-4bac-80db-6b1b1e587bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:42.959939 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1ea34-8dd1-4bac-80db-6b1b1e587bd0 None admin] PATH_INFO: `/v3/users/477386521552468a811547f4c4fd79df` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:42.976147 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1ea34-8dd1-4bac-80db-6b1b1e587bd0 None admin] RBAC: Authorizing `identity:get_user(user_id=477386521552468a811547f4c4fd79df)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:42.977932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1ea34-8dd1-4bac-80db-6b1b1e587bd0 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:42.979800 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 102/190] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:42 2022] GET /identity/v3/users/477386521552468a811547f4c4fd79df => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:42.992630 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1ea34-8dd1-4bac-80db-6b1b1e587bd0 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:43.037476 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:43.069124 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e550c15-865c-4479-9769-f09f71954a09 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:43.111512 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8adc89-6803-47b8-8a50-604d6aee5b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:43.112132 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8adc89-6803-47b8-8a50-604d6aee5b00 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:43.112410 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8adc89-6803-47b8-8a50-604d6aee5b00 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:43.113577 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8adc89-6803-47b8-8a50-604d6aee5b00 None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:43.113577 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8adc89-6803-47b8-8a50-604d6aee5b00 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:43.113777 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8adc89-6803-47b8-8a50-604d6aee5b00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:43.115070 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8adc89-6803-47b8-8a50-604d6aee5b00 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:43.123090 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:43.130120 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 89/191] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:50:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:43.130120 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8adc89-6803-47b8-8a50-604d6aee5b00 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:43.157100 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1ea34-8dd1-4bac-80db-6b1b1e587bd0 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:43.202484 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b4ce0-58bf-452d-a9a4-6c824e748f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:43.202871 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b4ce0-58bf-452d-a9a4-6c824e748f27 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:43.203151 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b4ce0-58bf-452d-a9a4-6c824e748f27 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:43.203423 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b4ce0-58bf-452d-a9a4-6c824e748f27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:43.249883 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8adc89-6803-47b8-8a50-604d6aee5b00 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:43.274796 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b4ce0-58bf-452d-a9a4-6c824e748f27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:43.276188 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b4ce0-58bf-452d-a9a4-6c824e748f27 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:43.286777 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192b605-0809-4cb3-b2d4-ab0d3cf56f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:43.287773 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192b605-0809-4cb3-b2d4-ab0d3cf56f2e None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:43.288011 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192b605-0809-4cb3-b2d4-ab0d3cf56f2e None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:43.288457 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192b605-0809-4cb3-b2d4-ab0d3cf56f2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:43.289983 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192b605-0809-4cb3-b2d4-ab0d3cf56f2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:43.291424 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192b605-0809-4cb3-b2d4-ab0d3cf56f2e None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:43.293599 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 90/192] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:50:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:43.298733 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192b605-0809-4cb3-b2d4-ab0d3cf56f2e None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:43.308580 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:43.357072 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:43.383115 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 103/193] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:50:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 03:50:43.384059 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b4ce0-58bf-452d-a9a4-6c824e748f27 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:43.407915 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192b605-0809-4cb3-b2d4-ab0d3cf56f2e None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:43.441824 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830962c7-000a-4d4a-8e52-3c53f5109869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:43.442450 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830962c7-000a-4d4a-8e52-3c53f5109869 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:43.442729 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830962c7-000a-4d4a-8e52-3c53f5109869 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:43.443059 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830962c7-000a-4d4a-8e52-3c53f5109869 None admin] PATH_INFO: `/v3/users/477386521552468a811547f4c4fd79df` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:43.444203 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830962c7-000a-4d4a-8e52-3c53f5109869 None admin] RBAC: Authorizing `identity:get_user(user_id=477386521552468a811547f4c4fd79df)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:43.445686 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830962c7-000a-4d4a-8e52-3c53f5109869 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:43.451801 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 91/194] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:43 2022] GET /identity/v3/users/477386521552468a811547f4c4fd79df => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:43.451801 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830962c7-000a-4d4a-8e52-3c53f5109869 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:43.501118 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b4ce0-58bf-452d-a9a4-6c824e748f27 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:43.524801 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:43.537853 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb9688-465e-4118-b6ed-cb4ae30d3d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:43.538398 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb9688-465e-4118-b6ed-cb4ae30d3d6c None admin] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:43.538669 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb9688-465e-4118-b6ed-cb4ae30d3d6c None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:43.538933 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb9688-465e-4118-b6ed-cb4ae30d3d6c None admin] PATH_INFO: `/v3/users` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:43.539574 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb9688-465e-4118-b6ed-cb4ae30d3d6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:43.541056 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb9688-465e-4118-b6ed-cb4ae30d3d6c None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:43.553013 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830962c7-000a-4d4a-8e52-3c53f5109869 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:43.565769 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 104/195] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 03:50:43 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:50:43.566845 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb9688-465e-4118-b6ed-cb4ae30d3d6c None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:43.603245 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf8dae-59f1-480d-a9ed-5291bd6b0ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:43.604381 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf8dae-59f1-480d-a9ed-5291bd6b0ea6 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:43.605005 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf8dae-59f1-480d-a9ed-5291bd6b0ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:43.605284 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf8dae-59f1-480d-a9ed-5291bd6b0ea6 None admin] PATH_INFO: `/v3/projects/a17a7b3783004ebe908993932c90f9d9` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:43.607090 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf8dae-59f1-480d-a9ed-5291bd6b0ea6 None admin] RBAC: Authorizing `identity:get_project(project_id=a17a7b3783004ebe908993932c90f9d9)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:43.608732 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf8dae-59f1-480d-a9ed-5291bd6b0ea6 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:43.615792 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:43.616161 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 92/196] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:50:43 2022] GET /identity/v3/projects/a17a7b3783004ebe908993932c90f9d9 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:43.617630 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf8dae-59f1-480d-a9ed-5291bd6b0ea6 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:43.697057 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb9688-465e-4118-b6ed-cb4ae30d3d6c None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:43.738342 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ab74a-e7cc-43fa-999f-b4bf1ef3d8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:43.738976 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ab74a-e7cc-43fa-999f-b4bf1ef3d8a0 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:43.739256 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ab74a-e7cc-43fa-999f-b4bf1ef3d8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:43.739527 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ab74a-e7cc-43fa-999f-b4bf1ef3d8a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:43.766732 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf8dae-59f1-480d-a9ed-5291bd6b0ea6 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:43.817983 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4249b33-40f0-4367-9540-d906a7746ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:43.819131 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4249b33-40f0-4367-9540-d906a7746ddc None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:43.819581 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4249b33-40f0-4367-9540-d906a7746ddc None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:43.820023 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4249b33-40f0-4367-9540-d906a7746ddc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:43.821687 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4249b33-40f0-4367-9540-d906a7746ddc None admin] RBAC: Adding query filter params (role.id=e154509f216e4ae59f74044aa234ddde, scope.project.id=a17a7b3783004ebe908993932c90f9d9, user.id=477386521552468a811547f4c4fd79df) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:43.822341 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4249b33-40f0-4367-9540-d906a7746ddc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:43.824646 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4249b33-40f0-4367-9540-d906a7746ddc None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:43.827468 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ab74a-e7cc-43fa-999f-b4bf1ef3d8a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:43.829988 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ab74a-e7cc-43fa-999f-b4bf1ef3d8a0 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:43.831011 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 93/197] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:50:43 2022] GET /identity/v3/role_assignments?user.id=477386521552468a811547f4c4fd79df&scope.project.id=a17a7b3783004ebe908993932c90f9d9&role.id=e154509f216e4ae59f74044aa234ddde => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:50:43.871595 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:43.963817 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 105/198] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:50:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:50:43.970289 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4249b33-40f0-4367-9540-d906a7746ddc None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:43.983677 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:44.051986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e96efd-6c8a-4b40-a4c7-88c5f697d71b None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:44.052359 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e96efd-6c8a-4b40-a4c7-88c5f697d71b None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:44.052927 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e96efd-6c8a-4b40-a4c7-88c5f697d71b None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:44.054365 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 106/199] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:44.059511 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713a458-33bc-4e67-bee8-f4e793d6f3b1 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:44.059799 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713a458-33bc-4e67-bee8-f4e793d6f3b1 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:44.060080 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713a458-33bc-4e67-bee8-f4e793d6f3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:44.083297 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-b713a458-33bc-4e67-bee8-f4e793d6f3b1 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:44.084440 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-b713a458-33bc-4e67-bee8-f4e793d6f3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:44.102838 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4249b33-40f0-4367-9540-d906a7746ddc None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:44.148299 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75eae7b-4d4d-4bc3-9a96-4e4bfedf7df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:44.149437 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75eae7b-4d4d-4bc3-9a96-4e4bfedf7df4 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:44.149919 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75eae7b-4d4d-4bc3-9a96-4e4bfedf7df4 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:44.150483 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75eae7b-4d4d-4bc3-9a96-4e4bfedf7df4 None admin] PATH_INFO: `/v3/projects/a17a7b3783004ebe908993932c90f9d9` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:44.153163 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75eae7b-4d4d-4bc3-9a96-4e4bfedf7df4 None admin] RBAC: Authorizing `identity:get_project(project_id=a17a7b3783004ebe908993932c90f9d9)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:44.155219 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75eae7b-4d4d-4bc3-9a96-4e4bfedf7df4 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:44.157436 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 94/200] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:50:43 2022] GET /identity/v3/projects/a17a7b3783004ebe908993932c90f9d9 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:44.164375 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 107/201] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:44.166937 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75eae7b-4d4d-4bc3-9a96-4e4bfedf7df4 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:44.255602 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:44.287865 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75eae7b-4d4d-4bc3-9a96-4e4bfedf7df4 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:44.324086 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7791beb-046b-4900-ac36-8afcd501931a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:44.325232 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7791beb-046b-4900-ac36-8afcd501931a None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:44.325511 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7791beb-046b-4900-ac36-8afcd501931a None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:44.325790 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7791beb-046b-4900-ac36-8afcd501931a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:44.326510 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7791beb-046b-4900-ac36-8afcd501931a None admin] RBAC: Adding query filter params (role.id=99bf21a1487942d3be2b9bdd4483d23e, scope.project.id=a17a7b3783004ebe908993932c90f9d9, user.id=477386521552468a811547f4c4fd79df) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:44.326815 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7791beb-046b-4900-ac36-8afcd501931a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:44.328275 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7791beb-046b-4900-ac36-8afcd501931a None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:44.334200 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 95/202] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:50:44 2022] GET /identity/v3/role_assignments?user.id=477386521552468a811547f4c4fd79df&scope.project.id=a17a7b3783004ebe908993932c90f9d9&role.id=99bf21a1487942d3be2b9bdd4483d23e => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:44.554169 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713a458-33bc-4e67-bee8-f4e793d6f3b1 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:44.621609 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:44.669460 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713a458-33bc-4e67-bee8-f4e793d6f3b1 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:44.722088 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a3f8a-5dea-456e-aa6e-a53a179604c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:44.722730 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a3f8a-5dea-456e-aa6e-a53a179604c4 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:44.723006 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a3f8a-5dea-456e-aa6e-a53a179604c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:44.723274 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a3f8a-5dea-456e-aa6e-a53a179604c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:44.738348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a3f8a-5dea-456e-aa6e-a53a179604c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:44.743003 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-134a3f8a-5dea-456e-aa6e-a53a179604c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 03:50:44.743003 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:44.743003 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:44.743003 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:44.743003 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:44.743003 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:44.743003 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:44.743003 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:44.743003 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:44.743003 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:44.743003 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:44.743003 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:44.743003 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:44.743003 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:44.743003 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:44.743003 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:44.743882 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:44.743882 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:44.743882 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:44.743882 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:44.743882 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:44.743882 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:44.743882 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:44.743882 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:44.743882 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:44.743882 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:44.743882 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:44.743882 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:44.743882 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:44.743882 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:44.743882 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:44.743882 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:44.744789 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:44.744789 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:44.744789 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:44.744789 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:44.744789 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:44.744789 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:44.744789 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:44.744789 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:44.744789 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:44.744789 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:44.744789 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 03:50:44.744789 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:50:44.744789 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 108/203] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:50:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:50:44.752136 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7791beb-046b-4900-ac36-8afcd501931a None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:44.915713 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7791beb-046b-4900-ac36-8afcd501931a None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:44.966590 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0984f60-6922-4070-bcdd-219489ff2da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:44.967203 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0984f60-6922-4070-bcdd-219489ff2da9 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:44.967484 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0984f60-6922-4070-bcdd-219489ff2da9 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:44.967762 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0984f60-6922-4070-bcdd-219489ff2da9 None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:44.968420 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0984f60-6922-4070-bcdd-219489ff2da9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:44.968753 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0984f60-6922-4070-bcdd-219489ff2da9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:44.970128 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0984f60-6922-4070-bcdd-219489ff2da9 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:44.981113 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:44.985941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 96/204] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 03:50:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:44.991558 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a3f8a-5dea-456e-aa6e-a53a179604c4 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:45.102814 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a3f8a-5dea-456e-aa6e-a53a179604c4 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:45.128886 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:45.154165 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cd670-9e74-4d31-8096-33624f0c33ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:45.155156 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cd670-9e74-4d31-8096-33624f0c33ce None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:45.155629 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cd670-9e74-4d31-8096-33624f0c33ce None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:45.156092 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cd670-9e74-4d31-8096-33624f0c33ce None admin] PATH_INFO: `/v3/users/73e660e8042d4b03aeaec4bb686d9d24` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:45.157476 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2cd670-9e74-4d31-8096-33624f0c33ce None admin] RBAC: Authorizing `identity:get_user(user_id=73e660e8042d4b03aeaec4bb686d9d24)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:45.159160 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2cd670-9e74-4d31-8096-33624f0c33ce None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:45.161340 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 109/205] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:44 2022] GET /identity/v3/users/73e660e8042d4b03aeaec4bb686d9d24 => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:45.170254 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0984f60-6922-4070-bcdd-219489ff2da9 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:45.331274 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0984f60-6922-4070-bcdd-219489ff2da9 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:45.378339 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b04b25-fabe-4fd3-822c-b52e61c67e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:45.378949 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b04b25-fabe-4fd3-822c-b52e61c67e26 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:45.379226 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b04b25-fabe-4fd3-822c-b52e61c67e26 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:45.379501 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b04b25-fabe-4fd3-822c-b52e61c67e26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:45.477720 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:45.481667 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b04b25-fabe-4fd3-822c-b52e61c67e26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:45.483648 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b04b25-fabe-4fd3-822c-b52e61c67e26 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:45.620865 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 97/206] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:50:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:50:45.626336 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cd670-9e74-4d31-8096-33624f0c33ce None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:45.774168 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cd670-9e74-4d31-8096-33624f0c33ce None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:45.809778 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d1f43-428f-4834-ae38-8682db0ddec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:45.810761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d1f43-428f-4834-ae38-8682db0ddec1 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:45.811230 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d1f43-428f-4834-ae38-8682db0ddec1 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:45.811688 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d1f43-428f-4834-ae38-8682db0ddec1 None admin] PATH_INFO: `/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:45.813090 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d1f43-428f-4834-ae38-8682db0ddec1 None admin] RBAC: Authorizing `identity:get_project(project_id=1cba8bf5387546e18ca3f132b9f78bc1)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:45.814756 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d1f43-428f-4834-ae38-8682db0ddec1 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:45.816608 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 110/207] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:50:45 2022] GET /identity/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:45.824511 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b04b25-fabe-4fd3-822c-b52e61c67e26 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:45.952150 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:45.958478 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b04b25-fabe-4fd3-822c-b52e61c67e26 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:46.007917 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105808fe-8081-4224-8b65-3696de418295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:46.008560 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105808fe-8081-4224-8b65-3696de418295 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:46.008839 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105808fe-8081-4224-8b65-3696de418295 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:46.009108 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105808fe-8081-4224-8b65-3696de418295 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:46.009830 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105808fe-8081-4224-8b65-3696de418295 None admin] RBAC: Adding query filter params (role.id=97127e19a070494a8ee32407f22bf958, scope.project.id=1cba8bf5387546e18ca3f132b9f78bc1, user.id=73e660e8042d4b03aeaec4bb686d9d24) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:46.010132 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105808fe-8081-4224-8b65-3696de418295 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:46.012317 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105808fe-8081-4224-8b65-3696de418295 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:46.018923 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 98/208] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:50:45 2022] GET /identity/v3/role_assignments?user.id=73e660e8042d4b03aeaec4bb686d9d24&scope.project.id=1cba8bf5387546e18ca3f132b9f78bc1&role.id=97127e19a070494a8ee32407f22bf958 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:46.473905 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0536c-ebcc-407a-9340-c889d6cf2c5a None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:46.474577 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0536c-ebcc-407a-9340-c889d6cf2c5a None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:46.475101 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0536c-ebcc-407a-9340-c889d6cf2c5a None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:46.476643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 111/209] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:46.483566 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f046f-2ad1-4df4-bf1d-05f5c94d1b75 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:46.484082 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f046f-2ad1-4df4-bf1d-05f5c94d1b75 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:46.484579 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f046f-2ad1-4df4-bf1d-05f5c94d1b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:46.505197 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-585f046f-2ad1-4df4-bf1d-05f5c94d1b75 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:46.506698 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-585f046f-2ad1-4df4-bf1d-05f5c94d1b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:46.542039 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b68b79-0a41-4aa1-9a01-250bba86be11 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:46.543189 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b68b79-0a41-4aa1-9a01-250bba86be11 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:46.543651 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b68b79-0a41-4aa1-9a01-250bba86be11 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:46.545216 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 112/210] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:46.551114 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566f563-e2f3-47a4-b8f5-b097102a5c8b None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:46.551662 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566f563-e2f3-47a4-b8f5-b097102a5c8b None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:46.552124 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566f563-e2f3-47a4-b8f5-b097102a5c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:46.575314 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-e566f563-e2f3-47a4-b8f5-b097102a5c8b None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:46.576896 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-e566f563-e2f3-47a4-b8f5-b097102a5c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:46.596836 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 99/211] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 03:50:46.598414 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad34adc-750b-46f1-bdd7-84c303c0d2a5 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:46.602309 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad34adc-750b-46f1-bdd7-84c303c0d2a5 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:46.602309 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad34adc-750b-46f1-bdd7-84c303c0d2a5 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:46.602309 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 100/212] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:46.608589 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5e00d-65fa-46b8-a599-5054709a2f39 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:46.609087 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5e00d-65fa-46b8-a599-5054709a2f39 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:46.609508 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5e00d-65fa-46b8-a599-5054709a2f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:46.629367 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-e1d5e00d-65fa-46b8-a599-5054709a2f39 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:46.630913 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-e1d5e00d-65fa-46b8-a599-5054709a2f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:46.643715 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:46.655408 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 113/213] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:46.705749 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 101/214] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 03:50:46.938084 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566f563-e2f3-47a4-b8f5-b097102a5c8b None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:46.994524 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5e00d-65fa-46b8-a599-5054709a2f39 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:47.028390 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:47.041465 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566f563-e2f3-47a4-b8f5-b097102a5c8b None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:47.081497 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f4a32-b146-4c1a-a128-24c529181020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:47.082148 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f4a32-b146-4c1a-a128-24c529181020 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:47.082423 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f4a32-b146-4c1a-a128-24c529181020 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:47.082692 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f4a32-b146-4c1a-a128-24c529181020 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:47.095951 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f4a32-b146-4c1a-a128-24c529181020 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:47.101540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-910f4a32-b146-4c1a-a128-24c529181020 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:50:47.101540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:47.101540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:47.101540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:47.101540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:47.101540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:47.101540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:47.101540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:47.101540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:47.101540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:47.101540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:47.101540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:47.101540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:47.101540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:47.101540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:47.101540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:47.102501 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:47.102501 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:47.102501 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:47.102501 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:47.102501 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:47.102501 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:47.102501 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:47.102501 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:47.102501 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:47.102501 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:47.102501 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:47.102501 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:47.102501 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:47.102501 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:47.102501 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:47.102501 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:47.103317 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:47.103317 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:47.103317 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:47.103317 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:47.103317 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:47.103317 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:47.103317 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:47.103317 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:47.103317 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:47.103317 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:47.103317 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:50:47.103317 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:50:47.103317 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 114/215] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 03:50:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:50:47.103980 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f4a32-b146-4c1a-a128-24c529181020 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:47.127744 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5e00d-65fa-46b8-a599-5054709a2f39 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:47.154644 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:47.177721 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede6cf6-7ffb-437e-ba43-e724f8dd2027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:47.178632 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede6cf6-7ffb-437e-ba43-e724f8dd2027 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:47.178907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede6cf6-7ffb-437e-ba43-e724f8dd2027 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:47.179178 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede6cf6-7ffb-437e-ba43-e724f8dd2027 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:47.181352 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede6cf6-7ffb-437e-ba43-e724f8dd2027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:47.183540 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede6cf6-7ffb-437e-ba43-e724f8dd2027 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:47.185314 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 102/216] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:50:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:47.185892 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede6cf6-7ffb-437e-ba43-e724f8dd2027 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:47.214225 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f4a32-b146-4c1a-a128-24c529181020 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:47.250350 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d0f12-a701-41cb-a281-427ca3309d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:47.250970 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d0f12-a701-41cb-a281-427ca3309d16 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:47.251248 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d0f12-a701-41cb-a281-427ca3309d16 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:47.251512 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d0f12-a701-41cb-a281-427ca3309d16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:47.261376 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d0f12-a701-41cb-a281-427ca3309d16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:47.266112 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-fb8d0f12-a701-41cb-a281-427ca3309d16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:50:47.266112 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:47.266112 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:47.266112 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:47.266112 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:47.266112 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:47.266112 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:47.266112 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:47.266112 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:47.266112 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:47.266112 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:47.266112 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:47.266112 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:47.266112 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:47.266112 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:47.266112 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:47.267026 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:47.267026 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:47.267026 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:47.267026 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:47.267026 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:47.267026 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:47.267026 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:47.267026 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:47.267026 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:47.267026 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:47.267026 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:47.267026 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:47.267026 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:47.267026 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:47.267026 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:47.267026 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:47.267824 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:47.267824 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:47.267824 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:47.267824 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:47.267824 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:47.267824 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:47.267824 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:47.267824 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:47.267824 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:47.267824 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:47.267824 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:50:47.267824 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:50:47.267824 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 115/217] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:50:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:50:47.269356 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d0f12-a701-41cb-a281-427ca3309d16 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:47.282355 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:47.291132 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede6cf6-7ffb-437e-ba43-e724f8dd2027 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:47.324628 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863dbca4-942a-477a-95d5-83da537f2965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:47.325220 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dbca4-942a-477a-95d5-83da537f2965 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:47.325498 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dbca4-942a-477a-95d5-83da537f2965 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:47.325761 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dbca4-942a-477a-95d5-83da537f2965 None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:47.326406 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863dbca4-942a-477a-95d5-83da537f2965 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:47.326702 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863dbca4-942a-477a-95d5-83da537f2965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:47.328052 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863dbca4-942a-477a-95d5-83da537f2965 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:47.335831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 103/218] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:50:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:47.336980 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f5ffd-097d-40b0-9637-2ae2afeac319 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:47.337261 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f5ffd-097d-40b0-9637-2ae2afeac319 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:47.337534 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f5ffd-097d-40b0-9637-2ae2afeac319 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:47.340432 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 104/219] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:47.340432 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f5ffd-097d-40b0-9637-2ae2afeac319 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:47.372760 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d0f12-a701-41cb-a281-427ca3309d16 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:47.382632 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:47.406484 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb587da6-087c-423e-8b7c-dfcb2619b787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:47.407079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb587da6-087c-423e-8b7c-dfcb2619b787 None admin] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:47.407354 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb587da6-087c-423e-8b7c-dfcb2619b787 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:47.407625 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb587da6-087c-423e-8b7c-dfcb2619b787 None admin] PATH_INFO: `/v3/users` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:47.408251 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb587da6-087c-423e-8b7c-dfcb2619b787 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:47.409723 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb587da6-087c-423e-8b7c-dfcb2619b787 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:47.430132 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 116/220] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 03:50:47 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:50:47.430949 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb587da6-087c-423e-8b7c-dfcb2619b787 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:47.447637 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f5ffd-097d-40b0-9637-2ae2afeac319 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:47.487838 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe6608-1ebd-455f-8749-3824f0f5de75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:47.488395 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe6608-1ebd-455f-8749-3824f0f5de75 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:47.488706 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe6608-1ebd-455f-8749-3824f0f5de75 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:47.488987 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe6608-1ebd-455f-8749-3824f0f5de75 None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:47.489668 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe6608-1ebd-455f-8749-3824f0f5de75 None admin] RBAC: Adding query filter params (name=member) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:47.489975 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe6608-1ebd-455f-8749-3824f0f5de75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:47.491415 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe6608-1ebd-455f-8749-3824f0f5de75 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:47.506025 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 105/221] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 03:50:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:47.506025 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fe096-895d-47f5-91e3-08a39f9875cc None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:47.506025 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fe096-895d-47f5-91e3-08a39f9875cc None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:47.506025 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fe096-895d-47f5-91e3-08a39f9875cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:47.522292 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-180fe096-895d-47f5-91e3-08a39f9875cc None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:47.523591 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-180fe096-895d-47f5-91e3-08a39f9875cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:47.536419 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:47.565138 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb587da6-087c-423e-8b7c-dfcb2619b787 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:47.603459 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 106/222] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:47.604406 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fe096-895d-47f5-91e3-08a39f9875cc None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:47.609811 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260b5b6-a84e-43a0-99ca-f48e345b809b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:47.610458 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260b5b6-a84e-43a0-99ca-f48e345b809b None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:47.610732 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260b5b6-a84e-43a0-99ca-f48e345b809b None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:47.611001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260b5b6-a84e-43a0-99ca-f48e345b809b None admin] PATH_INFO: `/v3/users/477386521552468a811547f4c4fd79df` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:47.612161 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260b5b6-a84e-43a0-99ca-f48e345b809b None admin] RBAC: Authorizing `identity:get_user(user_id=477386521552468a811547f4c4fd79df)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:47.613776 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260b5b6-a84e-43a0-99ca-f48e345b809b None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:47.615584 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 117/223] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:47 2022] GET /identity/v3/users/477386521552468a811547f4c4fd79df => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:47.621304 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260b5b6-a84e-43a0-99ca-f48e345b809b None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:47.668104 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:47.730747 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fe096-895d-47f5-91e3-08a39f9875cc None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:47.763007 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260b5b6-a84e-43a0-99ca-f48e345b809b None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:47.774125 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf081a4-49d0-4fd3-8179-13550d222456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:47.774311 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf081a4-49d0-4fd3-8179-13550d222456 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:47.774543 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf081a4-49d0-4fd3-8179-13550d222456 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:47.774777 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf081a4-49d0-4fd3-8179-13550d222456 None admin] PATH_INFO: `/v3/users/3471a4b50ed44f6282f53f42cbdcddd1` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:47.796512 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf081a4-49d0-4fd3-8179-13550d222456 None admin] RBAC: Authorizing `identity:get_user(user_id=3471a4b50ed44f6282f53f42cbdcddd1)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:47.796512 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf081a4-49d0-4fd3-8179-13550d222456 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:47.797765 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 107/224] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:47 2022] GET /identity/v3/users/3471a4b50ed44f6282f53f42cbdcddd1 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:47.803384 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf081a4-49d0-4fd3-8179-13550d222456 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:47.809076 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597f9d1-cd3f-43c1-a4dd-3933a5b61bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:47.810411 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:47.812031 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597f9d1-cd3f-43c1-a4dd-3933a5b61bc6 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:47.812519 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597f9d1-cd3f-43c1-a4dd-3933a5b61bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:47.813007 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597f9d1-cd3f-43c1-a4dd-3933a5b61bc6 None admin] PATH_INFO: `/v3/projects/a17a7b3783004ebe908993932c90f9d9` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:47.814401 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597f9d1-cd3f-43c1-a4dd-3933a5b61bc6 None admin] RBAC: Authorizing `identity:get_project(project_id=a17a7b3783004ebe908993932c90f9d9)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:47.817233 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597f9d1-cd3f-43c1-a4dd-3933a5b61bc6 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:47.819703 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 118/225] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:50:47 2022] GET /identity/v3/projects/a17a7b3783004ebe908993932c90f9d9 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:50:47.826478 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597f9d1-cd3f-43c1-a4dd-3933a5b61bc6 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:47.954648 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf081a4-49d0-4fd3-8179-13550d222456 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:47.967038 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597f9d1-cd3f-43c1-a4dd-3933a5b61bc6 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:47.969121 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:48.007661 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295355a-98fb-4377-9ae8-fca7bf6d2f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:48.008320 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295355a-98fb-4377-9ae8-fca7bf6d2f4c None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:48.008583 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295355a-98fb-4377-9ae8-fca7bf6d2f4c None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:48.008860 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295355a-98fb-4377-9ae8-fca7bf6d2f4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:48.017406 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92dc5c-6a80-4980-9713-ac245c00e55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:48.018006 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92dc5c-6a80-4980-9713-ac245c00e55c None admin] REQUEST_METHOD: `PUT` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:48.018285 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92dc5c-6a80-4980-9713-ac245c00e55c None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:48.018561 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92dc5c-6a80-4980-9713-ac245c00e55c None admin] PATH_INFO: `/v3/projects/a17a7b3783004ebe908993932c90f9d9/users/477386521552468a811547f4c4fd79df/roles/e154509f216e4ae59f74044aa234ddde` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:48.020552 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92dc5c-6a80-4980-9713-ac245c00e55c None admin] RBAC: Authorizing `identity:create_grant(project_id=a17a7b3783004ebe908993932c90f9d9, user_id=477386521552468a811547f4c4fd79df, role_id=e154509f216e4ae59f74044aa234ddde)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:48.022022 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92dc5c-6a80-4980-9713-ac245c00e55c None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:48.041144 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 119/226] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 03:50:47 2022] PUT /identity/v3/projects/a17a7b3783004ebe908993932c90f9d9/users/477386521552468a811547f4c4fd79df/roles/e154509f216e4ae59f74044aa234ddde => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 03:50:48.048769 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92dc5c-6a80-4980-9713-ac245c00e55c None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:48.149849 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295355a-98fb-4377-9ae8-fca7bf6d2f4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:48.153022 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295355a-98fb-4377-9ae8-fca7bf6d2f4c None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:48.159870 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:48.263879 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92dc5c-6a80-4980-9713-ac245c00e55c None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:48.279866 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 108/227] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:50:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:50:48.284323 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295355a-98fb-4377-9ae8-fca7bf6d2f4c None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:48.312237 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b23a1-300f-4a4a-ad9b-1171f74fb6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:48.313331 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b23a1-300f-4a4a-ad9b-1171f74fb6b6 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:48.313872 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b23a1-300f-4a4a-ad9b-1171f74fb6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:48.314378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b23a1-300f-4a4a-ad9b-1171f74fb6b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:48.325986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b23a1-300f-4a4a-ad9b-1171f74fb6b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:48.331719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-eb1b23a1-300f-4a4a-ad9b-1171f74fb6b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 03:50:48.331719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:48.331719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:48.331719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:48.331719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:48.331719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:48.331719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:48.331719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:48.331719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:48.331719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:48.331719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:48.331719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:48.331719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:48.331719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:48.331719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:48.331719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:48.332643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:48.332643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:48.332643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:48.332643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:48.332643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:48.332643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:48.332643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:48.332643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:48.332643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:48.332643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:48.332643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:48.332643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:48.332643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:48.332643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:48.332643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:48.332643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:48.333450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:48.333450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:48.333450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:48.333450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:48.333450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:48.333450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:48.333450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:48.333450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:48.333450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:48.333450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:48.333450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 03:50:48.333450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:50:48.335831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 120/228] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 03:50:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:50:48.342410 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b23a1-300f-4a4a-ad9b-1171f74fb6b6 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:48.377588 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:48.391765 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295355a-98fb-4377-9ae8-fca7bf6d2f4c None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:48.394164 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:48.429385 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791d665-e342-4fee-8754-88789029a277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:48.430377 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791d665-e342-4fee-8754-88789029a277 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:48.430890 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791d665-e342-4fee-8754-88789029a277 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:48.431380 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791d665-e342-4fee-8754-88789029a277 None admin] PATH_INFO: `/v3/projects/a17a7b3783004ebe908993932c90f9d9` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:48.432781 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791d665-e342-4fee-8754-88789029a277 None admin] RBAC: Authorizing `identity:get_project(project_id=a17a7b3783004ebe908993932c90f9d9)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:48.434651 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791d665-e342-4fee-8754-88789029a277 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:48.436636 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 109/229] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:50:48 2022] GET /identity/v3/projects/a17a7b3783004ebe908993932c90f9d9 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:50:48.442617 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791d665-e342-4fee-8754-88789029a277 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:48.476410 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b23a1-300f-4a4a-ad9b-1171f74fb6b6 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:48.519806 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042dff21-15de-40db-9375-5d2d37397c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:48.520419 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dff21-15de-40db-9375-5d2d37397c89 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:48.520726 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dff21-15de-40db-9375-5d2d37397c89 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:48.520998 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dff21-15de-40db-9375-5d2d37397c89 None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:48.521661 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042dff21-15de-40db-9375-5d2d37397c89 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:48.521958 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042dff21-15de-40db-9375-5d2d37397c89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:48.523346 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042dff21-15de-40db-9375-5d2d37397c89 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:48.534396 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 121/230] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:50:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:50:48.539855 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042dff21-15de-40db-9375-5d2d37397c89 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:48.582622 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791d665-e342-4fee-8754-88789029a277 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:48.652527 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c032e-ea19-4b54-b1fe-3b48c478d622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:48.653517 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c032e-ea19-4b54-b1fe-3b48c478d622 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:48.654234 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c032e-ea19-4b54-b1fe-3b48c478d622 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:48.654947 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c032e-ea19-4b54-b1fe-3b48c478d622 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:48.656792 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c032e-ea19-4b54-b1fe-3b48c478d622 None admin] RBAC: Adding query filter params (role.id=eaf433778e9e4d44bf6d1a1ea65d983f, scope.project.id=a17a7b3783004ebe908993932c90f9d9, user.id=3471a4b50ed44f6282f53f42cbdcddd1) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:48.658323 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c032e-ea19-4b54-b1fe-3b48c478d622 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:48.659972 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c032e-ea19-4b54-b1fe-3b48c478d622 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:48.664193 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:48.668787 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 110/231] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:50:48 2022] GET /identity/v3/role_assignments?user.id=3471a4b50ed44f6282f53f42cbdcddd1&scope.project.id=a17a7b3783004ebe908993932c90f9d9&role.id=eaf433778e9e4d44bf6d1a1ea65d983f => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:48.693507 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042dff21-15de-40db-9375-5d2d37397c89 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:48.746940 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781073cc-98e6-45d7-9d61-75959e26a22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:48.748032 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781073cc-98e6-45d7-9d61-75959e26a22d None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:48.748552 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781073cc-98e6-45d7-9d61-75959e26a22d None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:48.749042 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781073cc-98e6-45d7-9d61-75959e26a22d None admin] PATH_INFO: `/v3/users/477386521552468a811547f4c4fd79df` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:48.750459 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781073cc-98e6-45d7-9d61-75959e26a22d None admin] RBAC: Authorizing `identity:get_user(user_id=477386521552468a811547f4c4fd79df)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:48.752119 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781073cc-98e6-45d7-9d61-75959e26a22d None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:48.754053 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 122/232] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:48 2022] GET /identity/v3/users/477386521552468a811547f4c4fd79df => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:50:48.760170 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c032e-ea19-4b54-b1fe-3b48c478d622 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:48.809961 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:48.887391 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c032e-ea19-4b54-b1fe-3b48c478d622 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:48.941321 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42623089-42d0-4555-a44e-4b36b73ccadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:48.942396 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42623089-42d0-4555-a44e-4b36b73ccadc None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:48.942878 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42623089-42d0-4555-a44e-4b36b73ccadc None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:48.943371 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42623089-42d0-4555-a44e-4b36b73ccadc None admin] PATH_INFO: `/v3/projects/a17a7b3783004ebe908993932c90f9d9` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:48.944872 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42623089-42d0-4555-a44e-4b36b73ccadc None admin] RBAC: Authorizing `identity:get_project(project_id=a17a7b3783004ebe908993932c90f9d9)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:48.946531 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42623089-42d0-4555-a44e-4b36b73ccadc None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:48.948522 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 111/233] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:50:48 2022] GET /identity/v3/projects/a17a7b3783004ebe908993932c90f9d9 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:48.954679 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781073cc-98e6-45d7-9d61-75959e26a22d None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:49.082354 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781073cc-98e6-45d7-9d61-75959e26a22d None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:49.122596 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b747d3b-e3ff-439e-bb1b-0ddcfa78842b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:49.123689 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b747d3b-e3ff-439e-bb1b-0ddcfa78842b None admin] REQUEST_METHOD: `PUT` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:49.124199 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b747d3b-e3ff-439e-bb1b-0ddcfa78842b None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:49.124697 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b747d3b-e3ff-439e-bb1b-0ddcfa78842b None admin] PATH_INFO: `/v3/projects/a17a7b3783004ebe908993932c90f9d9/users/477386521552468a811547f4c4fd79df/roles/99bf21a1487942d3be2b9bdd4483d23e` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:49.128857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b747d3b-e3ff-439e-bb1b-0ddcfa78842b None admin] RBAC: Authorizing `identity:create_grant(project_id=a17a7b3783004ebe908993932c90f9d9, user_id=477386521552468a811547f4c4fd79df, role_id=99bf21a1487942d3be2b9bdd4483d23e)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:49.130515 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b747d3b-e3ff-439e-bb1b-0ddcfa78842b None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:49.157805 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 123/234] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 03:50:48 2022] PUT /identity/v3/projects/a17a7b3783004ebe908993932c90f9d9/users/477386521552468a811547f4c4fd79df/roles/99bf21a1487942d3be2b9bdd4483d23e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 03:50:50.312681 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4407ccc-cf89-44b6-830c-5e6cf424f6b4 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:50.313229 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4407ccc-cf89-44b6-830c-5e6cf424f6b4 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:50.313229 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4407ccc-cf89-44b6-830c-5e6cf424f6b4 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:50.314822 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 112/235] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:50.320043 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedb8e4-58a7-499e-b64f-6d53a1f064e9 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:50.320528 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedb8e4-58a7-499e-b64f-6d53a1f064e9 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:50.320633 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedb8e4-58a7-499e-b64f-6d53a1f064e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:50.349719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-7bedb8e4-58a7-499e-b64f-6d53a1f064e9 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:50.350938 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-7bedb8e4-58a7-499e-b64f-6d53a1f064e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:50.359837 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:50.385541 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb0117-d674-41f4-bab8-36004bd4f413 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:50.385862 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb0117-d674-41f4-bab8-36004bd4f413 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:50.386094 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb0117-d674-41f4-bab8-36004bd4f413 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:50.387839 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 113/236] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:50.393370 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7bff3-c0f9-4fb5-ab3f-bf9301ab220f None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:50.393648 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7bff3-c0f9-4fb5-ab3f-bf9301ab220f None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:50.393918 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7bff3-c0f9-4fb5-ab3f-bf9301ab220f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:50.429680 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-2ba7bff3-c0f9-4fb5-ab3f-bf9301ab220f None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:50.430988 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-2ba7bff3-c0f9-4fb5-ab3f-bf9301ab220f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:50.439324 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 124/237] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:50.552291 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 114/238] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:50.777577 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69ad5d-3e47-436e-939b-4dd766d6200a None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:50.777759 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69ad5d-3e47-436e-939b-4dd766d6200a None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:50.778035 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69ad5d-3e47-436e-939b-4dd766d6200a None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:50.779511 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 125/239] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:50.784632 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207dfae-b805-4d01-9c9a-c5735bfa1009 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:50.785149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207dfae-b805-4d01-9c9a-c5735bfa1009 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:50.785642 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207dfae-b805-4d01-9c9a-c5735bfa1009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:50.809395 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-9207dfae-b805-4d01-9c9a-c5735bfa1009 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:50.810897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-9207dfae-b805-4d01-9c9a-c5735bfa1009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:50.814332 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69ad5d-3e47-436e-939b-4dd766d6200a None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:50.860972 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:50.928423 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 115/240] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:50.981824 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69ad5d-3e47-436e-939b-4dd766d6200a None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:50.996475 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207dfae-b805-4d01-9c9a-c5735bfa1009 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:51.048173 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271b2a7-418d-4b59-9e31-f1406d50f70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:51.049242 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271b2a7-418d-4b59-9e31-f1406d50f70e None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:51.049743 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271b2a7-418d-4b59-9e31-f1406d50f70e None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:51.050231 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271b2a7-418d-4b59-9e31-f1406d50f70e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:51.062290 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271b2a7-418d-4b59-9e31-f1406d50f70e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:51.067603 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-6271b2a7-418d-4b59-9e31-f1406d50f70e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 03:50:51.067603 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:51.067603 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:51.067603 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:51.067603 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:51.067603 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:51.067603 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:51.067603 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:51.067603 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:51.067603 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:51.067603 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:51.067603 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:51.067603 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:51.067603 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:51.067603 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:51.067603 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:51.068775 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:51.068775 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:51.068775 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:51.068775 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:51.068775 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:51.068775 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:51.068775 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:51.068775 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:51.068775 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:51.068775 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:51.068775 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:51.068775 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:51.068775 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:51.068775 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:51.068775 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:51.068775 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:51.069635 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:51.069635 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:51.069635 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:51.069635 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:51.069635 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:51.069635 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:51.069635 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:51.069635 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:51.069635 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:51.069635 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:51.069635 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 03:50:51.069635 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:50:51.072272 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 126/241] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:50:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 03:50:51.078440 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271b2a7-418d-4b59-9e31-f1406d50f70e None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:51.083100 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:51.196451 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207dfae-b805-4d01-9c9a-c5735bfa1009 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:51.233122 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a3173-bbc6-4956-b8fe-fef8164d4a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:51.233759 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a3173-bbc6-4956-b8fe-fef8164d4a86 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:51.234033 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a3173-bbc6-4956-b8fe-fef8164d4a86 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:51.234304 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a3173-bbc6-4956-b8fe-fef8164d4a86 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:51.235860 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a3173-bbc6-4956-b8fe-fef8164d4a86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:51.237329 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a3173-bbc6-4956-b8fe-fef8164d4a86 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:51.238887 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 116/242] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:50:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:50:51.244869 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a3173-bbc6-4956-b8fe-fef8164d4a86 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:51.281512 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:51.345898 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271b2a7-418d-4b59-9e31-f1406d50f70e None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:51.348438 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a3173-bbc6-4956-b8fe-fef8164d4a86 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:51.391117 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4008c-f764-4276-84ec-1aa024104d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:51.391725 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4008c-f764-4276-84ec-1aa024104d29 None admin] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:51.392000 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4008c-f764-4276-84ec-1aa024104d29 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:51.392274 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4008c-f764-4276-84ec-1aa024104d29 None admin] PATH_INFO: `/v3/users` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:51.393018 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4008c-f764-4276-84ec-1aa024104d29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:51.394843 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4008c-f764-4276-84ec-1aa024104d29 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:51.406120 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e333f-3922-4395-b89c-d5080014c350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:51.407202 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e333f-3922-4395-b89c-d5080014c350 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:51.407680 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e333f-3922-4395-b89c-d5080014c350 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:51.408150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e333f-3922-4395-b89c-d5080014c350 None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:51.409060 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e333f-3922-4395-b89c-d5080014c350 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:51.409635 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e333f-3922-4395-b89c-d5080014c350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:51.410993 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e333f-3922-4395-b89c-d5080014c350 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:51.420109 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 127/243] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 03:50:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:50:51.421961 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 117/244] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 03:50:51 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 03:50:51.426736 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e333f-3922-4395-b89c-d5080014c350 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:51.429241 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4008c-f764-4276-84ec-1aa024104d29 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:51.549516 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:51.623434 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e333f-3922-4395-b89c-d5080014c350 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:51.628862 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:51.648762 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4008c-f764-4276-84ec-1aa024104d29 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:51.689070 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fc81a-991d-4f42-94ad-907115b96e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:51.689747 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fc81a-991d-4f42-94ad-907115b96e76 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:51.690028 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fc81a-991d-4f42-94ad-907115b96e76 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:51.690302 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fc81a-991d-4f42-94ad-907115b96e76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:51.697953 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f76d14-5bb2-4b7e-abe8-4d9d34331a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:51.698617 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f76d14-5bb2-4b7e-abe8-4d9d34331a0d None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:51.698969 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f76d14-5bb2-4b7e-abe8-4d9d34331a0d None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:51.699159 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f76d14-5bb2-4b7e-abe8-4d9d34331a0d None admin] PATH_INFO: `/v3/users/08e289a5eecc4b839d55046fca99997a` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:51.707349 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787fc81a-991d-4f42-94ad-907115b96e76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:51.714470 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-787fc81a-991d-4f42-94ad-907115b96e76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:50:51.714470 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:51.714470 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:51.714470 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:51.714470 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:51.714470 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:51.714470 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:51.714470 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:51.714470 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:51.714470 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:51.714470 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:51.714470 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:51.714470 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:51.714470 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:51.714470 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:51.714470 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:51.715440 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:51.715440 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:51.715440 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:51.715440 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:51.715440 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:51.715440 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:51.715440 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:51.715440 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:51.715440 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:51.715440 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:51.715440 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:51.715440 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:51.715440 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:51.715440 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:51.715440 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:51.715440 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:51.716259 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:51.716259 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:51.716259 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:51.716259 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:51.716259 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:51.716259 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:51.716259 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:51.716259 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:51.716259 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:51.716259 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:51.716259 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:50:51.716259 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:50:51.716259 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 128/245] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 03:50:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:50:51.718617 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86436b2b-b0a5-40d3-9883-5383793effbd None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:51.718617 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86436b2b-b0a5-40d3-9883-5383793effbd None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:51.718617 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86436b2b-b0a5-40d3-9883-5383793effbd None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:51.719202 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 129/246] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:51.724646 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f76d14-5bb2-4b7e-abe8-4d9d34331a0d None admin] RBAC: Authorizing `identity:get_user(user_id=08e289a5eecc4b839d55046fca99997a)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:51.724823 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df120a28-2cdc-4bca-8495-428cf50cabf7 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:51.725020 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df120a28-2cdc-4bca-8495-428cf50cabf7 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:51.725304 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df120a28-2cdc-4bca-8495-428cf50cabf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:51.726486 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f76d14-5bb2-4b7e-abe8-4d9d34331a0d None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:51.728438 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 118/247] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:51 2022] GET /identity/v3/users/08e289a5eecc4b839d55046fca99997a => generated 297 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:51.729921 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f76d14-5bb2-4b7e-abe8-4d9d34331a0d None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:51.746349 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-df120a28-2cdc-4bca-8495-428cf50cabf7 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:51.747920 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-df120a28-2cdc-4bca-8495-428cf50cabf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:51.840818 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 130/248] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:51.841637 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df120a28-2cdc-4bca-8495-428cf50cabf7 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:51.892114 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f76d14-5bb2-4b7e-abe8-4d9d34331a0d None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:51.909177 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:51.941038 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca5a78-ebd4-49e7-8489-b5ebf6617fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:51.941647 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca5a78-ebd4-49e7-8489-b5ebf6617fd1 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:51.941920 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca5a78-ebd4-49e7-8489-b5ebf6617fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:51.942189 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca5a78-ebd4-49e7-8489-b5ebf6617fd1 None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:51.942853 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca5a78-ebd4-49e7-8489-b5ebf6617fd1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:51.943154 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca5a78-ebd4-49e7-8489-b5ebf6617fd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:51.945369 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca5a78-ebd4-49e7-8489-b5ebf6617fd1 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:51.954081 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 119/249] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:50:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:51.955289 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be940e69-193f-4ecf-a6d4-462d0af0336e None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:51.955643 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be940e69-193f-4ecf-a6d4-462d0af0336e None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:51.955918 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be940e69-193f-4ecf-a6d4-462d0af0336e None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:51.959782 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 120/250] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:51.962885 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be940e69-193f-4ecf-a6d4-462d0af0336e None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:51.972174 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df120a28-2cdc-4bca-8495-428cf50cabf7 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:51.974623 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:52.025292 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e05cbb-a842-4493-a91e-b1056ba795a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:52.026316 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e05cbb-a842-4493-a91e-b1056ba795a6 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:52.026661 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e05cbb-a842-4493-a91e-b1056ba795a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:52.026996 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e05cbb-a842-4493-a91e-b1056ba795a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:52.091522 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be940e69-193f-4ecf-a6d4-462d0af0336e None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:52.121974 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e05cbb-a842-4493-a91e-b1056ba795a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:52.124218 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e05cbb-a842-4493-a91e-b1056ba795a6 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:52.130401 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff711d-3084-49f0-925d-4985f3a356e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:52.131286 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff711d-3084-49f0-925d-4985f3a356e5 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:52.131743 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff711d-3084-49f0-925d-4985f3a356e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:52.132196 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff711d-3084-49f0-925d-4985f3a356e5 None admin] PATH_INFO: `/v3/users/477386521552468a811547f4c4fd79df` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:52.133585 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff711d-3084-49f0-925d-4985f3a356e5 None admin] RBAC: Authorizing `identity:get_user(user_id=477386521552468a811547f4c4fd79df)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:52.135774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff711d-3084-49f0-925d-4985f3a356e5 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:52.137603 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 121/251] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:51 2022] GET /identity/v3/users/477386521552468a811547f4c4fd79df => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:52.138958 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf4d35-3239-49db-8f67-a905b3ec60d0 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:52.139447 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf4d35-3239-49db-8f67-a905b3ec60d0 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:52.139924 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf4d35-3239-49db-8f67-a905b3ec60d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:52.158974 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-90bf4d35-3239-49db-8f67-a905b3ec60d0 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:52.160472 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-90bf4d35-3239-49db-8f67-a905b3ec60d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:52.195634 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:52.265031 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 122/252] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:52.266527 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf4d35-3239-49db-8f67-a905b3ec60d0 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:52.276654 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:52.284104 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 131/253] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:50:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:50:52.290174 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e05cbb-a842-4493-a91e-b1056ba795a6 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:52.385718 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf4d35-3239-49db-8f67-a905b3ec60d0 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:52.426784 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76f45a-af3b-44c8-aa88-73e93331c64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:52.427318 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76f45a-af3b-44c8-aa88-73e93331c64d None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:52.427591 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76f45a-af3b-44c8-aa88-73e93331c64d None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:52.427859 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76f45a-af3b-44c8-aa88-73e93331c64d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:52.485061 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e05cbb-a842-4493-a91e-b1056ba795a6 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:52.506981 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76f45a-af3b-44c8-aa88-73e93331c64d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:52.508597 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76f45a-af3b-44c8-aa88-73e93331c64d None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:52.525103 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:52.528020 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2cd69-9d7a-4ef9-9f39-74a269802480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:52.529294 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2cd69-9d7a-4ef9-9f39-74a269802480 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:52.529977 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2cd69-9d7a-4ef9-9f39-74a269802480 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:52.530460 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2cd69-9d7a-4ef9-9f39-74a269802480 None admin] PATH_INFO: `/v3/projects/a17a7b3783004ebe908993932c90f9d9` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:52.532225 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2cd69-9d7a-4ef9-9f39-74a269802480 None admin] RBAC: Authorizing `identity:get_project(project_id=a17a7b3783004ebe908993932c90f9d9)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:52.534081 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2cd69-9d7a-4ef9-9f39-74a269802480 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:52.535917 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 132/254] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:50:52 2022] GET /identity/v3/projects/a17a7b3783004ebe908993932c90f9d9 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:52.542146 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2cd69-9d7a-4ef9-9f39-74a269802480 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:52.569412 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:52.665689 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2cd69-9d7a-4ef9-9f39-74a269802480 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:52.677346 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 123/255] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:50:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:50:52.678128 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76f45a-af3b-44c8-aa88-73e93331c64d None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:52.709326 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34104cd-1000-4866-a247-cfee58f80417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:52.710640 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34104cd-1000-4866-a247-cfee58f80417 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:52.711298 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34104cd-1000-4866-a247-cfee58f80417 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:52.712110 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34104cd-1000-4866-a247-cfee58f80417 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:52.727677 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34104cd-1000-4866-a247-cfee58f80417 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:52.734854 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-f34104cd-1000-4866-a247-cfee58f80417 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:50:52.734854 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:52.734854 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:52.734854 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:52.734854 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:52.734854 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:52.734854 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:52.734854 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:52.734854 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:52.734854 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:52.734854 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:52.734854 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:52.734854 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:52.734854 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:52.734854 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:52.734854 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:52.735753 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:52.735753 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:52.735753 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:52.735753 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:52.735753 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:52.735753 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:52.735753 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:52.735753 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:52.735753 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:52.735753 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:52.735753 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:52.735753 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:52.735753 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:52.735753 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:52.735753 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:52.735753 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:52.736589 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:52.736589 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:52.736589 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:52.736589 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:52.736589 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:52.736589 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:52.736589 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:52.736589 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:52.736589 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:52.736589 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:52.736589 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:50:52.736589 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:50:52.738150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 133/256] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:50:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:50:52.738552 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34104cd-1000-4866-a247-cfee58f80417 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:52.800989 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76f45a-af3b-44c8-aa88-73e93331c64d None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:52.816796 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:52.828942 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:52.846462 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0544946-1b08-4770-88f2-b6272ee714eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:52.847355 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0544946-1b08-4770-88f2-b6272ee714eb None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:52.847855 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0544946-1b08-4770-88f2-b6272ee714eb None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:52.848327 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0544946-1b08-4770-88f2-b6272ee714eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:52.849126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34104cd-1000-4866-a247-cfee58f80417 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:52.849841 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0544946-1b08-4770-88f2-b6272ee714eb None admin] RBAC: Adding query filter params (role.id=97127e19a070494a8ee32407f22bf958, scope.project.id=a17a7b3783004ebe908993932c90f9d9, user.id=08e289a5eecc4b839d55046fca99997a) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:52.850401 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0544946-1b08-4770-88f2-b6272ee714eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:52.853151 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0544946-1b08-4770-88f2-b6272ee714eb None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:52.860441 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 124/257] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:50:52 2022] GET /identity/v3/role_assignments?user.id=08e289a5eecc4b839d55046fca99997a&scope.project.id=a17a7b3783004ebe908993932c90f9d9&role.id=97127e19a070494a8ee32407f22bf958 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:52.868529 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0544946-1b08-4770-88f2-b6272ee714eb None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:52.915023 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80de0a-14e8-44fe-a7cd-b5b76e2fa62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:52.915931 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80de0a-14e8-44fe-a7cd-b5b76e2fa62b None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:52.916208 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80de0a-14e8-44fe-a7cd-b5b76e2fa62b None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:52.916492 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80de0a-14e8-44fe-a7cd-b5b76e2fa62b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:52.943477 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80de0a-14e8-44fe-a7cd-b5b76e2fa62b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:52.957228 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-0d80de0a-14e8-44fe-a7cd-b5b76e2fa62b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 03:50:52.957228 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:52.957228 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:52.957228 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:52.957228 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:52.957228 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:52.957228 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:52.957228 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:52.957228 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:52.957228 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:52.957228 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:52.957228 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:52.957228 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:52.957228 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:52.957228 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:52.957228 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:52.958563 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:52.958563 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:52.958563 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:52.958563 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:52.958563 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:52.958563 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:52.958563 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:52.958563 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:52.958563 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:52.958563 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:52.958563 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:52.958563 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:52.958563 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:52.958563 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:52.958563 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:52.958563 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:52.959385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:52.959385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:52.959385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:52.959385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:52.959385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:52.959385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:52.959385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:52.959385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:52.959385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:52.959385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:52.959385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 03:50:52.959385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:50:52.959385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 134/258] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 03:50:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:50:52.959385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80de0a-14e8-44fe-a7cd-b5b76e2fa62b None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:53.105014 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80de0a-14e8-44fe-a7cd-b5b76e2fa62b None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:53.119355 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0544946-1b08-4770-88f2-b6272ee714eb None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:53.149028 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d43ce-b888-43de-a47d-cd64c3690f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:53.150878 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d43ce-b888-43de-a47d-cd64c3690f27 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:53.151160 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d43ce-b888-43de-a47d-cd64c3690f27 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:53.151431 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d43ce-b888-43de-a47d-cd64c3690f27 None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:53.152231 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d43ce-b888-43de-a47d-cd64c3690f27 None admin] RBAC: Adding query filter params (name=member) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:53.152670 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d43ce-b888-43de-a47d-cd64c3690f27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:53.154386 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d43ce-b888-43de-a47d-cd64c3690f27 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:53.164810 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 135/259] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 03:50:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:53.165651 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d43ce-b888-43de-a47d-cd64c3690f27 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:53.174462 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:53.177348 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2dc00-f405-49b1-a7c8-ff2de19854c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:53.178582 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2dc00-f405-49b1-a7c8-ff2de19854c0 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:53.179073 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2dc00-f405-49b1-a7c8-ff2de19854c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:53.179549 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2dc00-f405-49b1-a7c8-ff2de19854c0 None admin] PATH_INFO: `/v3/projects/a17a7b3783004ebe908993932c90f9d9` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:53.181046 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2dc00-f405-49b1-a7c8-ff2de19854c0 None admin] RBAC: Authorizing `identity:get_project(project_id=a17a7b3783004ebe908993932c90f9d9)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:53.183594 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2dc00-f405-49b1-a7c8-ff2de19854c0 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:53.185953 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 125/260] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:50:52 2022] GET /identity/v3/projects/a17a7b3783004ebe908993932c90f9d9 => generated 302 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:53.187082 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2dc00-f405-49b1-a7c8-ff2de19854c0 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:53.259234 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:53.297409 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d43ce-b888-43de-a47d-cd64c3690f27 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:53.346232 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d4a72-2b01-4e71-8e0f-691a33f04a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:53.347335 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d4a72-2b01-4e71-8e0f-691a33f04a68 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:53.347811 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d4a72-2b01-4e71-8e0f-691a33f04a68 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:53.348273 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d4a72-2b01-4e71-8e0f-691a33f04a68 None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:53.349148 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d4a72-2b01-4e71-8e0f-691a33f04a68 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:53.349790 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d4a72-2b01-4e71-8e0f-691a33f04a68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:53.351495 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d4a72-2b01-4e71-8e0f-691a33f04a68 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:53.364505 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2dc00-f405-49b1-a7c8-ff2de19854c0 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:53.375091 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 136/261] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:50:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:53.376199 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d4a72-2b01-4e71-8e0f-691a33f04a68 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:53.400875 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef4c38-4594-4830-b6ea-7f039f29b851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:53.401515 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef4c38-4594-4830-b6ea-7f039f29b851 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:53.401789 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef4c38-4594-4830-b6ea-7f039f29b851 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:53.402063 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef4c38-4594-4830-b6ea-7f039f29b851 None admin] PATH_INFO: `/v3/users/3471a4b50ed44f6282f53f42cbdcddd1` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:53.403216 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef4c38-4594-4830-b6ea-7f039f29b851 None admin] RBAC: Authorizing `identity:get_user(user_id=3471a4b50ed44f6282f53f42cbdcddd1)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:53.408522 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef4c38-4594-4830-b6ea-7f039f29b851 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:53.408522 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 126/262] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:53 2022] GET /identity/v3/users/3471a4b50ed44f6282f53f42cbdcddd1 => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:53.408522 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef4c38-4594-4830-b6ea-7f039f29b851 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:53.512920 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:53.572147 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef4c38-4594-4830-b6ea-7f039f29b851 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:53.576411 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d4a72-2b01-4e71-8e0f-691a33f04a68 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:53.580444 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:53.609136 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e414e6-ed67-486b-b8a8-487d2dbcb708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:53.610016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e414e6-ed67-486b-b8a8-487d2dbcb708 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:53.610516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e414e6-ed67-486b-b8a8-487d2dbcb708 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:53.610933 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e414e6-ed67-486b-b8a8-487d2dbcb708 None admin] PATH_INFO: `/v3/users/477386521552468a811547f4c4fd79df` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:53.612248 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e414e6-ed67-486b-b8a8-487d2dbcb708 None admin] RBAC: Authorizing `identity:get_user(user_id=477386521552468a811547f4c4fd79df)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:53.613868 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e414e6-ed67-486b-b8a8-487d2dbcb708 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:53.615598 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 127/263] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:53 2022] GET /identity/v3/users/477386521552468a811547f4c4fd79df => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:53.616506 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e414e6-ed67-486b-b8a8-487d2dbcb708 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:53.680640 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e16ca-cad2-4d07-a724-e6092577a027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:53.681251 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e16ca-cad2-4d07-a724-e6092577a027 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:53.682098 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e16ca-cad2-4d07-a724-e6092577a027 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:53.682376 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e16ca-cad2-4d07-a724-e6092577a027 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:53.683199 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e16ca-cad2-4d07-a724-e6092577a027 None admin] RBAC: Adding query filter params (role.id=e154509f216e4ae59f74044aa234ddde, scope.project.id=a17a7b3783004ebe908993932c90f9d9, user.id=477386521552468a811547f4c4fd79df) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:53.683516 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e16ca-cad2-4d07-a724-e6092577a027 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:53.685214 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e16ca-cad2-4d07-a724-e6092577a027 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:53.703215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 137/264] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:50:53 2022] GET /identity/v3/role_assignments?user.id=477386521552468a811547f4c4fd79df&scope.project.id=a17a7b3783004ebe908993932c90f9d9&role.id=e154509f216e4ae59f74044aa234ddde => generated 608 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:53.704281 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e16ca-cad2-4d07-a724-e6092577a027 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:53.727692 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e414e6-ed67-486b-b8a8-487d2dbcb708 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:53.766397 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb22ce-0c6d-4397-a035-095058f2462d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:53.767355 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb22ce-0c6d-4397-a035-095058f2462d None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:53.767825 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb22ce-0c6d-4397-a035-095058f2462d None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:53.768242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb22ce-0c6d-4397-a035-095058f2462d None admin] PATH_INFO: `/v3/projects/a17a7b3783004ebe908993932c90f9d9` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:53.769635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb22ce-0c6d-4397-a035-095058f2462d None admin] RBAC: Authorizing `identity:get_project(project_id=a17a7b3783004ebe908993932c90f9d9)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:53.771269 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb22ce-0c6d-4397-a035-095058f2462d None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:53.773142 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 128/265] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:50:53 2022] GET /identity/v3/projects/a17a7b3783004ebe908993932c90f9d9 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:53.779955 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb22ce-0c6d-4397-a035-095058f2462d None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:53.867237 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:53.910581 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e16ca-cad2-4d07-a724-e6092577a027 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:53.930580 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb22ce-0c6d-4397-a035-095058f2462d None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:53.969821 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392595af-3f27-477f-a9af-960273be7c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:53.970814 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392595af-3f27-477f-a9af-960273be7c4b None admin] REQUEST_METHOD: `PUT` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:53.971273 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392595af-3f27-477f-a9af-960273be7c4b None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:53.971727 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392595af-3f27-477f-a9af-960273be7c4b None admin] PATH_INFO: `/v3/projects/a17a7b3783004ebe908993932c90f9d9/users/3471a4b50ed44f6282f53f42cbdcddd1/roles/eaf433778e9e4d44bf6d1a1ea65d983f` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:53.974356 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392595af-3f27-477f-a9af-960273be7c4b None admin] RBAC: Authorizing `identity:create_grant(project_id=a17a7b3783004ebe908993932c90f9d9, user_id=3471a4b50ed44f6282f53f42cbdcddd1, role_id=eaf433778e9e4d44bf6d1a1ea65d983f)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:53.976046 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392595af-3f27-477f-a9af-960273be7c4b None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:53.986287 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:53.993585 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 129/266] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 03:50:53 2022] PUT /identity/v3/projects/a17a7b3783004ebe908993932c90f9d9/users/3471a4b50ed44f6282f53f42cbdcddd1/roles/eaf433778e9e4d44bf6d1a1ea65d983f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 03:50:54.010578 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96822e-a9db-4cbc-872e-ac7646620fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:54.011212 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96822e-a9db-4cbc-872e-ac7646620fce None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:54.011488 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96822e-a9db-4cbc-872e-ac7646620fce None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:54.011758 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96822e-a9db-4cbc-872e-ac7646620fce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:54.124677 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96822e-a9db-4cbc-872e-ac7646620fce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:54.126225 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96822e-a9db-4cbc-872e-ac7646620fce None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:54.188557 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59cff9-062c-4914-84a1-f6fcd298316a None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:54.189193 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59cff9-062c-4914-84a1-f6fcd298316a None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:54.189651 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59cff9-062c-4914-84a1-f6fcd298316a None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:54.191348 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 130/267] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:54.198651 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95205656-6488-4ff4-905e-fc8513eb22c4 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:54.199372 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95205656-6488-4ff4-905e-fc8513eb22c4 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:54.199976 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95205656-6488-4ff4-905e-fc8513eb22c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:54.232444 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-95205656-6488-4ff4-905e-fc8513eb22c4 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:54.234135 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-95205656-6488-4ff4-905e-fc8513eb22c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:54.316145 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 138/268] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:50:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:50:54.323531 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96822e-a9db-4cbc-872e-ac7646620fce None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:54.323939 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 131/269] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 03:50:54.358852 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:54.440692 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96822e-a9db-4cbc-872e-ac7646620fce None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:54.486168 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd1f31-f5f6-441b-9557-c54619f302b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:54.486904 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd1f31-f5f6-441b-9557-c54619f302b7 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:54.487247 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd1f31-f5f6-441b-9557-c54619f302b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:54.487529 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd1f31-f5f6-441b-9557-c54619f302b7 None admin] PATH_INFO: `/v3/projects/a17a7b3783004ebe908993932c90f9d9` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:54.492287 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd1f31-f5f6-441b-9557-c54619f302b7 None admin] RBAC: Authorizing `identity:get_project(project_id=a17a7b3783004ebe908993932c90f9d9)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:54.493935 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd1f31-f5f6-441b-9557-c54619f302b7 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:54.495870 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 139/270] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:50:54 2022] GET /identity/v3/projects/a17a7b3783004ebe908993932c90f9d9 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:54.502247 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95205656-6488-4ff4-905e-fc8513eb22c4 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:54.550235 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:54.649153 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95205656-6488-4ff4-905e-fc8513eb22c4 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:54.674462 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8de08d-8025-4de9-ab29-247852e5974b None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:54.674970 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8de08d-8025-4de9-ab29-247852e5974b None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:54.675077 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8de08d-8025-4de9-ab29-247852e5974b None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:54.676563 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 140/271] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:54.681750 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b0eb2-6ae2-4f9b-be3c-cc6885c25893 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:54.682034 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b0eb2-6ae2-4f9b-be3c-cc6885c25893 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:54.682303 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b0eb2-6ae2-4f9b-be3c-cc6885c25893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:54.693734 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93987c61-e4fa-4e80-a61f-33b68f3c8ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:54.694371 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93987c61-e4fa-4e80-a61f-33b68f3c8ff0 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:54.694648 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93987c61-e4fa-4e80-a61f-33b68f3c8ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:54.694916 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93987c61-e4fa-4e80-a61f-33b68f3c8ff0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:54.695630 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93987c61-e4fa-4e80-a61f-33b68f3c8ff0 None admin] RBAC: Adding query filter params (role.id=99bf21a1487942d3be2b9bdd4483d23e, scope.project.id=a17a7b3783004ebe908993932c90f9d9, user.id=477386521552468a811547f4c4fd79df) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:54.695929 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93987c61-e4fa-4e80-a61f-33b68f3c8ff0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:54.697925 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93987c61-e4fa-4e80-a61f-33b68f3c8ff0 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:54.704373 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 132/272] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:50:54 2022] GET /identity/v3/role_assignments?user.id=477386521552468a811547f4c4fd79df&scope.project.id=a17a7b3783004ebe908993932c90f9d9&role.id=99bf21a1487942d3be2b9bdd4483d23e => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:54.717924 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-395b0eb2-6ae2-4f9b-be3c-cc6885c25893 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:54.719208 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-395b0eb2-6ae2-4f9b-be3c-cc6885c25893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:54.807715 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 141/273] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:54.835706 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93987c61-e4fa-4e80-a61f-33b68f3c8ff0 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:54.985697 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:54.992163 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93987c61-e4fa-4e80-a61f-33b68f3c8ff0 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:55.044433 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe83c4-9a31-4aed-bfcb-6b083dfd22e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:55.045501 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe83c4-9a31-4aed-bfcb-6b083dfd22e3 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:55.045787 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe83c4-9a31-4aed-bfcb-6b083dfd22e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:55.046061 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe83c4-9a31-4aed-bfcb-6b083dfd22e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:55.061620 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe83c4-9a31-4aed-bfcb-6b083dfd22e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:55.066907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-7ffe83c4-9a31-4aed-bfcb-6b083dfd22e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:50:55.066907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:55.066907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:55.066907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:55.066907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:55.066907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:55.066907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:55.066907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:55.066907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:55.066907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:55.066907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:55.066907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:55.066907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:55.066907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:55.066907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:55.066907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:55.067812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:55.067812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:55.067812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:55.067812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:55.067812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:55.067812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:55.067812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:55.067812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:55.067812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:55.067812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:55.067812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:55.067812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:55.067812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:55.067812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:55.067812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:55.067812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:55.068658 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:55.068658 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:55.068658 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:55.068658 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:55.068658 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:55.068658 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:55.068658 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:55.068658 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:55.068658 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:55.068658 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:55.068658 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:50:55.068658 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:50:55.068658 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 133/274] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:50:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:50:55.075987 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b0eb2-6ae2-4f9b-be3c-cc6885c25893 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:55.113539 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:55.188614 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe83c4-9a31-4aed-bfcb-6b083dfd22e3 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:55.199918 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b0eb2-6ae2-4f9b-be3c-cc6885c25893 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:55.239769 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d45ec-f5f2-4116-8e6f-4b30007accfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:55.240294 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d45ec-f5f2-4116-8e6f-4b30007accfa None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:55.240598 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d45ec-f5f2-4116-8e6f-4b30007accfa None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:55.240873 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d45ec-f5f2-4116-8e6f-4b30007accfa None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:55.241531 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d45ec-f5f2-4116-8e6f-4b30007accfa None admin] RBAC: Adding query filter params (name=member) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:55.241829 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d45ec-f5f2-4116-8e6f-4b30007accfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:55.243228 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d45ec-f5f2-4116-8e6f-4b30007accfa None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:55.254090 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 142/275] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 03:50:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:55.261497 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d45ec-f5f2-4116-8e6f-4b30007accfa None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:55.314519 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe83c4-9a31-4aed-bfcb-6b083dfd22e3 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:55.350131 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ca828-b9be-40d5-9564-4e64efb73fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:55.351180 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ca828-b9be-40d5-9564-4e64efb73fb3 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:55.351655 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ca828-b9be-40d5-9564-4e64efb73fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:55.352165 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ca828-b9be-40d5-9564-4e64efb73fb3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:55.354050 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ca828-b9be-40d5-9564-4e64efb73fb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:55.355784 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ca828-b9be-40d5-9564-4e64efb73fb3 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:55.362442 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:55.362704 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 134/276] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:50:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:50:55.364101 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ca828-b9be-40d5-9564-4e64efb73fb3 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:55.370078 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d45ec-f5f2-4116-8e6f-4b30007accfa None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:55.405008 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:55.406554 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa5cba-b28b-42b6-bab2-e35d24101a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:55.407311 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa5cba-b28b-42b6-bab2-e35d24101a51 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:55.407683 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa5cba-b28b-42b6-bab2-e35d24101a51 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:55.408086 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa5cba-b28b-42b6-bab2-e35d24101a51 None admin] PATH_INFO: `/v3/users/9c6af07957074cb99bc010bb5c7a9def` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:55.425758 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa5cba-b28b-42b6-bab2-e35d24101a51 None admin] RBAC: Authorizing `identity:get_user(user_id=9c6af07957074cb99bc010bb5c7a9def)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:55.427731 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa5cba-b28b-42b6-bab2-e35d24101a51 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:55.429277 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 143/277] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:55 2022] GET /identity/v3/users/9c6af07957074cb99bc010bb5c7a9def => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:55.435200 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa5cba-b28b-42b6-bab2-e35d24101a51 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:55.477983 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ca828-b9be-40d5-9564-4e64efb73fb3 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:55.519987 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e0c97-3616-4919-877b-3598b7454079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:55.521316 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e0c97-3616-4919-877b-3598b7454079 None admin] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:55.521829 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e0c97-3616-4919-877b-3598b7454079 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:55.522302 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e0c97-3616-4919-877b-3598b7454079 None admin] PATH_INFO: `/v3/users` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:55.523147 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e0c97-3616-4919-877b-3598b7454079 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:55.525249 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e0c97-3616-4919-877b-3598b7454079 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:55.551264 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa5cba-b28b-42b6-bab2-e35d24101a51 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:55.560853 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 135/278] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 03:50:55 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:50:55.593369 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451ccad-356b-4195-9e1a-3aafe3e38299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:55.593991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451ccad-356b-4195-9e1a-3aafe3e38299 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:55.594264 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451ccad-356b-4195-9e1a-3aafe3e38299 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:55.594535 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451ccad-356b-4195-9e1a-3aafe3e38299 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:55.595266 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d451ccad-356b-4195-9e1a-3aafe3e38299 None admin] RBAC: Adding query filter params (role.id=eaf433778e9e4d44bf6d1a1ea65d983f, user.id=9c6af07957074cb99bc010bb5c7a9def, scope.system=all) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:55.595571 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d451ccad-356b-4195-9e1a-3aafe3e38299 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:55.597247 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d451ccad-356b-4195-9e1a-3aafe3e38299 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:55.603323 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 144/279] 10.222.0.43 () {56 vars in 1308 bytes} [Fri Aug 19 03:50:55 2022] GET /identity/v3/role_assignments?user.id=9c6af07957074cb99bc010bb5c7a9def&scope.system=all&role.id=eaf433778e9e4d44bf6d1a1ea65d983f => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:50:55.665533 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0f3c3-49d9-49be-adea-90d914ba9b2a None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:55.665869 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0f3c3-49d9-49be-adea-90d914ba9b2a None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:55.666090 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0f3c3-49d9-49be-adea-90d914ba9b2a None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:55.667974 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 136/280] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:55.674007 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd63fc-149f-4487-b436-1339c847e34b None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:55.674312 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd63fc-149f-4487-b436-1339c847e34b None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:55.674579 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd63fc-149f-4487-b436-1339c847e34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:55.694777 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-8fbd63fc-149f-4487-b436-1339c847e34b None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:55.696009 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-8fbd63fc-149f-4487-b436-1339c847e34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:55.709765 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:55.787863 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 145/281] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:56.163233 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0f3c3-49d9-49be-adea-90d914ba9b2a None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:56.277199 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:56.308633 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0f3c3-49d9-49be-adea-90d914ba9b2a None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:56.351507 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e6b22-4871-4cdb-9b2a-703ec1f74f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:56.352145 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e6b22-4871-4cdb-9b2a-703ec1f74f9e None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:56.352421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e6b22-4871-4cdb-9b2a-703ec1f74f9e None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:56.352822 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e6b22-4871-4cdb-9b2a-703ec1f74f9e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:56.370345 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e6b22-4871-4cdb-9b2a-703ec1f74f9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:56.375192 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-c46e6b22-4871-4cdb-9b2a-703ec1f74f9e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 03:50:56.375192 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:56.375192 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:56.375192 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:56.375192 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:56.375192 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:56.375192 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:56.375192 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:56.375192 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:56.375192 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:56.375192 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:56.375192 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:56.375192 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:56.375192 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:56.375192 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:56.375192 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:56.376062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:56.376062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:56.376062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:56.376062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:56.376062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:56.376062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:56.376062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:56.376062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:56.376062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:56.376062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:56.376062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:56.376062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:56.376062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:56.376062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:56.376062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:56.376062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:56.376941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:56.376941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:56.376941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:56.376941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:56.376941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:56.376941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:56.376941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:56.376941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:56.376941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:56.376941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:56.376941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 03:50:56.376941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:50:56.376941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 137/282] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:50:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:50:56.382548 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd63fc-149f-4487-b436-1339c847e34b None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:56.510646 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd63fc-149f-4487-b436-1339c847e34b None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:56.556592 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e2d84-f32b-4ccf-b302-0cccca9d911c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:56.557541 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e2d84-f32b-4ccf-b302-0cccca9d911c None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:56.558045 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e2d84-f32b-4ccf-b302-0cccca9d911c None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:56.558507 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e2d84-f32b-4ccf-b302-0cccca9d911c None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:56.559375 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e2d84-f32b-4ccf-b302-0cccca9d911c None admin] RBAC: Adding query filter params (name=reader) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:56.559885 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e2d84-f32b-4ccf-b302-0cccca9d911c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:56.561478 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e2d84-f32b-4ccf-b302-0cccca9d911c None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:56.575279 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 146/283] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 03:50:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:56.580826 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e6b22-4871-4cdb-9b2a-703ec1f74f9e None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:56.721593 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e6b22-4871-4cdb-9b2a-703ec1f74f9e None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:56.763419 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5ff0e-a824-4f1a-addd-4277d33df64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:56.763986 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5ff0e-a824-4f1a-addd-4277d33df64d None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:56.764266 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5ff0e-a824-4f1a-addd-4277d33df64d None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:56.764642 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5ff0e-a824-4f1a-addd-4277d33df64d None admin] PATH_INFO: `/v3/users/08e289a5eecc4b839d55046fca99997a` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:56.765801 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5ff0e-a824-4f1a-addd-4277d33df64d None admin] RBAC: Authorizing `identity:get_user(user_id=08e289a5eecc4b839d55046fca99997a)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:56.767259 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5ff0e-a824-4f1a-addd-4277d33df64d None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:56.769032 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 138/284] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:56 2022] GET /identity/v3/users/08e289a5eecc4b839d55046fca99997a => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:56.774963 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e2d84-f32b-4ccf-b302-0cccca9d911c None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:56.792568 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:56.925484 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e2d84-f32b-4ccf-b302-0cccca9d911c None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:56.942510 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff78c8c-3071-4eb0-816f-88e748a178bd None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:56.943130 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff78c8c-3071-4eb0-816f-88e748a178bd None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:56.943622 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff78c8c-3071-4eb0-816f-88e748a178bd None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:56.945753 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 139/285] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 03:50:56.951838 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95030759-73d8-496e-9e4c-5bdc128891ce None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:56.952844 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95030759-73d8-496e-9e4c-5bdc128891ce None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:56.953633 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95030759-73d8-496e-9e4c-5bdc128891ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:56.976136 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-95030759-73d8-496e-9e4c-5bdc128891ce None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:56.976795 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e6c5e-2310-434a-a42e-89db50721ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:56.977972 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e6c5e-2310-434a-a42e-89db50721ab7 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:56.978261 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e6c5e-2310-434a-a42e-89db50721ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:56.978535 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e6c5e-2310-434a-a42e-89db50721ab7 None admin] PATH_INFO: `/v3/projects/a17a7b3783004ebe908993932c90f9d9` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:56.979116 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-95030759-73d8-496e-9e4c-5bdc128891ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:56.981557 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e6c5e-2310-434a-a42e-89db50721ab7 None admin] RBAC: Authorizing `identity:get_project(project_id=a17a7b3783004ebe908993932c90f9d9)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:56.983651 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e6c5e-2310-434a-a42e-89db50721ab7 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:56.984196 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:56.986987 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 147/286] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:50:56 2022] GET /identity/v3/projects/a17a7b3783004ebe908993932c90f9d9 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:56.992042 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e6c5e-2310-434a-a42e-89db50721ab7 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:57.101273 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:57.124506 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 140/287] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 03:50:57.146535 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e6c5e-2310-434a-a42e-89db50721ab7 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:57.197994 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f83063-f68f-4fbb-a99b-5a9a6071ef4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:57.199008 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f83063-f68f-4fbb-a99b-5a9a6071ef4d None admin] REQUEST_METHOD: `PUT` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:57.199487 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f83063-f68f-4fbb-a99b-5a9a6071ef4d None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:57.199961 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f83063-f68f-4fbb-a99b-5a9a6071ef4d None admin] PATH_INFO: `/v3/projects/a17a7b3783004ebe908993932c90f9d9/users/08e289a5eecc4b839d55046fca99997a/roles/97127e19a070494a8ee32407f22bf958` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:57.202227 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f83063-f68f-4fbb-a99b-5a9a6071ef4d None admin] RBAC: Authorizing `identity:create_grant(project_id=a17a7b3783004ebe908993932c90f9d9, user_id=08e289a5eecc4b839d55046fca99997a, role_id=97127e19a070494a8ee32407f22bf958)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:57.203922 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f83063-f68f-4fbb-a99b-5a9a6071ef4d None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:57.219141 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 148/288] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 03:50:56 2022] PUT /identity/v3/projects/a17a7b3783004ebe908993932c90f9d9/users/08e289a5eecc4b839d55046fca99997a/roles/97127e19a070494a8ee32407f22bf958 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 03:50:57.585838 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95030759-73d8-496e-9e4c-5bdc128891ce None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:57.701876 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95030759-73d8-496e-9e4c-5bdc128891ce None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:57.744160 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6375e-ccdc-44e6-8588-779fac6fcea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:57.744807 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6375e-ccdc-44e6-8588-779fac6fcea7 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:57.745085 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6375e-ccdc-44e6-8588-779fac6fcea7 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:57.745357 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6375e-ccdc-44e6-8588-779fac6fcea7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:57.758032 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:57.762016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f6375e-ccdc-44e6-8588-779fac6fcea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:57.767251 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-e8f6375e-ccdc-44e6-8588-779fac6fcea7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:50:57.767251 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:57.767251 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:57.767251 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:57.767251 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:57.767251 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:57.767251 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:57.767251 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:57.767251 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:57.767251 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:57.767251 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:57.767251 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:57.767251 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:57.767251 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:57.767251 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:57.767251 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:57.768136 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:57.768136 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:57.768136 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:57.768136 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:57.768136 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:57.768136 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:57.768136 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:57.768136 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:57.768136 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:57.768136 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:57.768136 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:57.768136 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:57.768136 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:57.768136 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:57.768136 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:57.768136 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:57.769016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:57.769016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:57.769016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:57.769016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:57.769016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:57.769016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:57.769016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:57.769016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:57.769016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:57.769016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:57.769016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:50:57.769016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:50:57.774857 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 141/289] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:50:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:50:57.780250 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f83063-f68f-4fbb-a99b-5a9a6071ef4d None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:57.945414 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f83063-f68f-4fbb-a99b-5a9a6071ef4d None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:57.984882 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:57.992107 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fcf8a-42af-4e54-92e4-b36cfbae254f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:57.993292 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fcf8a-42af-4e54-92e4-b36cfbae254f None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:57.993862 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fcf8a-42af-4e54-92e4-b36cfbae254f None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:57.994487 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fcf8a-42af-4e54-92e4-b36cfbae254f None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:57.995562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fcf8a-42af-4e54-92e4-b36cfbae254f None admin] RBAC: Adding query filter params (name=member) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:57.995871 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fcf8a-42af-4e54-92e4-b36cfbae254f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:57.997345 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fcf8a-42af-4e54-92e4-b36cfbae254f None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:58.006575 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 149/290] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 03:50:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:58.013576 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6375e-ccdc-44e6-8588-779fac6fcea7 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:58.177592 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6375e-ccdc-44e6-8588-779fac6fcea7 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:58.213762 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d5365-c480-46af-9321-45dd6f25aaf8 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:58.214031 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d5365-c480-46af-9321-45dd6f25aaf8 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:58.214235 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d5365-c480-46af-9321-45dd6f25aaf8 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:58.217307 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 150/291] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 03:50:58.221182 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5cdb8-898a-451d-ba5d-1c2d7a026623 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:58.221470 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5cdb8-898a-451d-ba5d-1c2d7a026623 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:58.221752 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5cdb8-898a-451d-ba5d-1c2d7a026623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:58.234703 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60beda97-82ce-407d-ab70-58f4ef2f7703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:58.235336 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60beda97-82ce-407d-ab70-58f4ef2f7703 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:58.235614 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60beda97-82ce-407d-ab70-58f4ef2f7703 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:58.236749 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60beda97-82ce-407d-ab70-58f4ef2f7703 None admin] PATH_INFO: `/v3/users/3471a4b50ed44f6282f53f42cbdcddd1` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:58.237974 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60beda97-82ce-407d-ab70-58f4ef2f7703 None admin] RBAC: Authorizing `identity:get_user(user_id=3471a4b50ed44f6282f53f42cbdcddd1)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:58.239446 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60beda97-82ce-407d-ab70-58f4ef2f7703 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:58.250624 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 142/292] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:58 2022] GET /identity/v3/users/3471a4b50ed44f6282f53f42cbdcddd1 => generated 297 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:58.251536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60beda97-82ce-407d-ab70-58f4ef2f7703 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:58.258122 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-b5f5cdb8-898a-451d-ba5d-1c2d7a026623 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:58.259890 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-b5f5cdb8-898a-451d-ba5d-1c2d7a026623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:58.374280 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:58.391862 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 151/293] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 03:50:58.434431 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60beda97-82ce-407d-ab70-58f4ef2f7703 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:58.460621 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cab620-c9c5-4537-93f0-9940f66ffccd None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:58.460919 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cab620-c9c5-4537-93f0-9940f66ffccd None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:58.461244 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cab620-c9c5-4537-93f0-9940f66ffccd None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:58.464429 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 152/294] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 03:50:58.468432 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c44441-86e1-4970-9664-dc7a9ee7e0c1 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:58.468762 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c44441-86e1-4970-9664-dc7a9ee7e0c1 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:58.469040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c44441-86e1-4970-9664-dc7a9ee7e0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:58.490099 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4943673-e165-467f-9e91-bad00adfd5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:58.490715 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4943673-e165-467f-9e91-bad00adfd5e9 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:58.490989 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4943673-e165-467f-9e91-bad00adfd5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:58.491265 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4943673-e165-467f-9e91-bad00adfd5e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:58.506112 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-12c44441-86e1-4970-9664-dc7a9ee7e0c1 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:58.507309 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-12c44441-86e1-4970-9664-dc7a9ee7e0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:58.590906 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4943673-e165-467f-9e91-bad00adfd5e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:58.592381 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4943673-e165-467f-9e91-bad00adfd5e9 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:58.599122 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 153/295] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:50:58.600992 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d853a-907d-4c39-9d42-1dc9295935f3 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:58.601487 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d853a-907d-4c39-9d42-1dc9295935f3 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:58.601951 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d853a-907d-4c39-9d42-1dc9295935f3 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:58.603403 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 154/296] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:58.615691 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad86909-c8a9-4bab-9746-1fc474d1e90c None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:58.616237 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad86909-c8a9-4bab-9746-1fc474d1e90c None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:58.616725 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad86909-c8a9-4bab-9746-1fc474d1e90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:58.650261 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-8ad86909-c8a9-4bab-9746-1fc474d1e90c None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:58.651687 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-8ad86909-c8a9-4bab-9746-1fc474d1e90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:58.684088 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:58.736937 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:58.744634 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 155/297] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 03:50:58.758230 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 143/298] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:50:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:50:58.764464 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad86909-c8a9-4bab-9746-1fc474d1e90c None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:58.884875 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad86909-c8a9-4bab-9746-1fc474d1e90c None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:58.925967 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4943673-e165-467f-9e91-bad00adfd5e9 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:58.932501 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ab8a1-7389-44f6-a8d2-4c14dee870ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:58.932501 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ab8a1-7389-44f6-a8d2-4c14dee870ed None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:58.932501 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ab8a1-7389-44f6-a8d2-4c14dee870ed None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:58.932501 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ab8a1-7389-44f6-a8d2-4c14dee870ed None admin] PATH_INFO: `/v3/projects/a17a7b3783004ebe908993932c90f9d9` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:58.932853 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ab8a1-7389-44f6-a8d2-4c14dee870ed None admin] RBAC: Authorizing `identity:get_project(project_id=a17a7b3783004ebe908993932c90f9d9)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:58.933467 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ab8a1-7389-44f6-a8d2-4c14dee870ed None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:58.936353 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 156/299] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:50:58 2022] GET /identity/v3/projects/a17a7b3783004ebe908993932c90f9d9 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:58.947517 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ab8a1-7389-44f6-a8d2-4c14dee870ed None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:59.016955 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:59.065874 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ab8a1-7389-44f6-a8d2-4c14dee870ed None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:59.081115 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4943673-e165-467f-9e91-bad00adfd5e9 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:59.101735 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5b415-9c2d-4f85-a4ab-1b6751828b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:59.102889 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5b415-9c2d-4f85-a4ab-1b6751828b63 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:59.107352 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5b415-9c2d-4f85-a4ab-1b6751828b63 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:59.107352 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5b415-9c2d-4f85-a4ab-1b6751828b63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:59.107352 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5b415-9c2d-4f85-a4ab-1b6751828b63 None admin] RBAC: Adding query filter params (role.id=eaf433778e9e4d44bf6d1a1ea65d983f, scope.project.id=a17a7b3783004ebe908993932c90f9d9, user.id=3471a4b50ed44f6282f53f42cbdcddd1) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:59.107352 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5b415-9c2d-4f85-a4ab-1b6751828b63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:59.107352 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5b415-9c2d-4f85-a4ab-1b6751828b63 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:59.112896 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 157/300] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:50:58 2022] GET /identity/v3/role_assignments?user.id=3471a4b50ed44f6282f53f42cbdcddd1&scope.project.id=a17a7b3783004ebe908993932c90f9d9&role.id=eaf433778e9e4d44bf6d1a1ea65d983f => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:59.113785 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5b415-9c2d-4f85-a4ab-1b6751828b63 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:59.127767 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda4ece-fb2f-4023-9396-42369e30c8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:59.128430 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda4ece-fb2f-4023-9396-42369e30c8fa None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:59.128742 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda4ece-fb2f-4023-9396-42369e30c8fa None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:59.129018 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda4ece-fb2f-4023-9396-42369e30c8fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:59.141689 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda4ece-fb2f-4023-9396-42369e30c8fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:59.146703 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-adda4ece-fb2f-4023-9396-42369e30c8fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:50:59.146703 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:59.146703 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:59.146703 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:59.146703 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:59.146703 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:59.146703 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:59.146703 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:59.146703 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:59.146703 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:59.146703 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:59.146703 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:59.146703 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:59.146703 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:59.146703 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:59.146703 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:59.147715 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:59.147715 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:59.147715 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:59.147715 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:59.147715 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:59.147715 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:59.147715 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:59.147715 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:59.147715 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:59.147715 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:59.147715 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:59.147715 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:59.147715 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:59.147715 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:59.147715 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:59.147715 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:59.148834 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:59.148834 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:59.148834 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:59.148834 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:59.148834 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:59.148834 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:59.148834 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:59.148834 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:59.148834 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:59.148834 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:59.148834 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:50:59.148834 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:50:59.148834 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 144/301] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:50:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 03:50:59.150088 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda4ece-fb2f-4023-9396-42369e30c8fa None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:59.196202 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:59.264463 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5b415-9c2d-4f85-a4ab-1b6751828b63 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:59.285823 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:59.291351 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda4ece-fb2f-4023-9396-42369e30c8fa None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:59.312103 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01861e47-b2fa-40a4-9d4a-20d01ad747e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:59.312830 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01861e47-b2fa-40a4-9d4a-20d01ad747e5 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:59.313112 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01861e47-b2fa-40a4-9d4a-20d01ad747e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:59.313386 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01861e47-b2fa-40a4-9d4a-20d01ad747e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:59.325689 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01861e47-b2fa-40a4-9d4a-20d01ad747e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:50:59.329800 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbed16-c235-4907-8615-b00788815d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:59.330504 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-01861e47-b2fa-40a4-9d4a-20d01ad747e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 03:50:59.330504 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:50:59.330504 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:50:59.330504 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:50:59.330504 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:50:59.330504 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:50:59.330504 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:50:59.330504 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:50:59.330504 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:50:59.330504 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:50:59.330504 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:50:59.330504 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:50:59.330504 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:50:59.330504 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:50:59.330504 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:50:59.330504 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:50:59.331379 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:50:59.331379 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:50:59.331379 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:50:59.331379 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:50:59.331379 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:50:59.331379 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:50:59.331379 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:50:59.331379 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:50:59.331379 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:50:59.331379 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:50:59.331379 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:50:59.331379 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:50:59.331379 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:50:59.331379 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:50:59.331379 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:50:59.331379 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:50:59.332205 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:50:59.332205 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:50:59.332205 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:50:59.332205 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:50:59.332205 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:50:59.332205 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:50:59.332205 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:50:59.332205 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:50:59.332205 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:50:59.332205 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:50:59.332205 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 03:50:59.332205 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:50:59.332205 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 158/302] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:50:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:50:59.332967 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01861e47-b2fa-40a4-9d4a-20d01ad747e5 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:59.336990 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbed16-c235-4907-8615-b00788815d91 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:59.336990 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbed16-c235-4907-8615-b00788815d91 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:59.336990 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbed16-c235-4907-8615-b00788815d91 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:59.336990 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbed16-c235-4907-8615-b00788815d91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:59.337305 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbed16-c235-4907-8615-b00788815d91 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:59.339350 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 145/303] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:50:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:59.342896 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbed16-c235-4907-8615-b00788815d91 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:59.454209 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01861e47-b2fa-40a4-9d4a-20d01ad747e5 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:59.456969 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:59.465874 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbed16-c235-4907-8615-b00788815d91 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:59.490873 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fdf43-0847-4ccb-a9af-957e56ce06fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:59.491501 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fdf43-0847-4ccb-a9af-957e56ce06fa None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:59.491765 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fdf43-0847-4ccb-a9af-957e56ce06fa None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:59.492030 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fdf43-0847-4ccb-a9af-957e56ce06fa None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:59.492733 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fdf43-0847-4ccb-a9af-957e56ce06fa None admin] RBAC: Adding query filter params (name=member) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:59.493041 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fdf43-0847-4ccb-a9af-957e56ce06fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:59.494419 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fdf43-0847-4ccb-a9af-957e56ce06fa None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:59.501277 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc2c12-6e76-4e34-8a5d-f5f8bfb8c584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:59.501872 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc2c12-6e76-4e34-8a5d-f5f8bfb8c584 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:59.502146 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc2c12-6e76-4e34-8a5d-f5f8bfb8c584 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:59.502416 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc2c12-6e76-4e34-8a5d-f5f8bfb8c584 None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:59.502888 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 159/304] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 03:50:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:59.503067 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc2c12-6e76-4e34-8a5d-f5f8bfb8c584 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:50:59.503366 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc2c12-6e76-4e34-8a5d-f5f8bfb8c584 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:59.503671 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fdf43-0847-4ccb-a9af-957e56ce06fa None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:59.508659 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc2c12-6e76-4e34-8a5d-f5f8bfb8c584 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:59.515696 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 146/305] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 03:50:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:50:59.516660 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc2c12-6e76-4e34-8a5d-f5f8bfb8c584 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:59.551849 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:59.618379 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fdf43-0847-4ccb-a9af-957e56ce06fa None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:59.628633 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc2c12-6e76-4e34-8a5d-f5f8bfb8c584 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:59.654277 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96eddb-0d3d-47c9-8eda-552456e3f9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:59.654884 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96eddb-0d3d-47c9-8eda-552456e3f9af None admin] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:59.655165 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96eddb-0d3d-47c9-8eda-552456e3f9af None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:59.655434 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96eddb-0d3d-47c9-8eda-552456e3f9af None admin] PATH_INFO: `/v3/groups` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:59.656037 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96eddb-0d3d-47c9-8eda-552456e3f9af None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:59.657501 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96eddb-0d3d-47c9-8eda-552456e3f9af None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:59.665028 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451374a9-61b7-4583-b60c-6f16f40172ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:59.665837 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451374a9-61b7-4583-b60c-6f16f40172ef None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:59.666146 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451374a9-61b7-4583-b60c-6f16f40172ef None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:59.666437 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451374a9-61b7-4583-b60c-6f16f40172ef None admin] PATH_INFO: `/v3/users/9c6af07957074cb99bc010bb5c7a9def` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:59.667841 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451374a9-61b7-4583-b60c-6f16f40172ef None admin] RBAC: Authorizing `identity:get_user(user_id=9c6af07957074cb99bc010bb5c7a9def)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:59.669394 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451374a9-61b7-4583-b60c-6f16f40172ef None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:59.671092 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 147/306] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:59 2022] GET /identity/v3/users/9c6af07957074cb99bc010bb5c7a9def => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:59.675661 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 160/307] 10.222.0.43 () {60 vars in 1134 bytes} [Fri Aug 19 03:50:59 2022] POST /identity/v3/groups => generated 229 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:50:59.684834 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96eddb-0d3d-47c9-8eda-552456e3f9af None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:59.685012 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451374a9-61b7-4583-b60c-6f16f40172ef None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:50:59.719272 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:59.803150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:50:59.807814 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96eddb-0d3d-47c9-8eda-552456e3f9af None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:59.842005 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451374a9-61b7-4583-b60c-6f16f40172ef None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:50:59.852523 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a9b48-b711-4246-b52a-a0af48c46228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:59.853182 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a9b48-b711-4246-b52a-a0af48c46228 None admin] REQUEST_METHOD: `PUT` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:59.853464 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a9b48-b711-4246-b52a-a0af48c46228 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:59.853743 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a9b48-b711-4246-b52a-a0af48c46228 None admin] PATH_INFO: `/v3/system/users/9c6af07957074cb99bc010bb5c7a9def/roles/eaf433778e9e4d44bf6d1a1ea65d983f` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:59.855230 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a9b48-b711-4246-b52a-a0af48c46228 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9c6af07957074cb99bc010bb5c7a9def, role_id=eaf433778e9e4d44bf6d1a1ea65d983f)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:59.856681 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a9b48-b711-4246-b52a-a0af48c46228 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:59.869188 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 161/308] 10.222.0.43 () {58 vars in 1334 bytes} [Fri Aug 19 03:50:59 2022] PUT /identity/v3/system/users/9c6af07957074cb99bc010bb5c7a9def/roles/eaf433778e9e4d44bf6d1a1ea65d983f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 03:50:59.869188 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013de22-e42b-4fc9-86fd-db5b083fbcff None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:59.869188 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013de22-e42b-4fc9-86fd-db5b083fbcff None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:59.869188 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013de22-e42b-4fc9-86fd-db5b083fbcff None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:59.869622 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 162/309] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:50:59.874842 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e4de8-de44-4108-a42d-55eecb10549e None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:59.875131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e4de8-de44-4108-a42d-55eecb10549e None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:59.875417 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e4de8-de44-4108-a42d-55eecb10549e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:59.890518 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde131f-7366-4cc6-8b87-d8e48e107267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:50:59.891355 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde131f-7366-4cc6-8b87-d8e48e107267 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:50:59.891736 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde131f-7366-4cc6-8b87-d8e48e107267 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:50:59.892138 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde131f-7366-4cc6-8b87-d8e48e107267 None admin] PATH_INFO: `/v3/users/75af3d2c654d4222ae148c7744293514` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:50:59.896547 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-875e4de8-de44-4108-a42d-55eecb10549e None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:50:59.897947 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-875e4de8-de44-4108-a42d-55eecb10549e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:50:59.912297 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde131f-7366-4cc6-8b87-d8e48e107267 None admin] RBAC: Authorizing `identity:get_user(user_id=75af3d2c654d4222ae148c7744293514)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:50:59.913975 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde131f-7366-4cc6-8b87-d8e48e107267 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:50:59.920516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 148/310] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:50:59 2022] GET /identity/v3/users/75af3d2c654d4222ae148c7744293514 => generated 293 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:50:59.922755 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde131f-7366-4cc6-8b87-d8e48e107267 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:00.002198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 163/311] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 03:51:00.038163 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:00.060643 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde131f-7366-4cc6-8b87-d8e48e107267 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:00.098572 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773da8e7-ffdc-4c2a-9a25-e68eb05c3ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:00.099469 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773da8e7-ffdc-4c2a-9a25-e68eb05c3ece None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:00.099889 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773da8e7-ffdc-4c2a-9a25-e68eb05c3ece None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:00.100304 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773da8e7-ffdc-4c2a-9a25-e68eb05c3ece None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:00.101253 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773da8e7-ffdc-4c2a-9a25-e68eb05c3ece None admin] RBAC: Adding query filter params (role.id=97127e19a070494a8ee32407f22bf958, user.id=75af3d2c654d4222ae148c7744293514, scope.system=all) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:00.101765 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773da8e7-ffdc-4c2a-9a25-e68eb05c3ece None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:00.103393 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773da8e7-ffdc-4c2a-9a25-e68eb05c3ece None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:00.109631 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 149/312] 10.222.0.43 () {56 vars in 1308 bytes} [Fri Aug 19 03:50:59 2022] GET /identity/v3/role_assignments?user.id=75af3d2c654d4222ae148c7744293514&scope.system=all&role.id=97127e19a070494a8ee32407f22bf958 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:00.346510 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e4de8-de44-4108-a42d-55eecb10549e None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:00.445093 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:00.455968 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e4de8-de44-4108-a42d-55eecb10549e None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:00.493820 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08844e87-cd4a-4dc2-abe5-a0bf7858784f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:00.494557 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08844e87-cd4a-4dc2-abe5-a0bf7858784f None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:00.494906 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08844e87-cd4a-4dc2-abe5-a0bf7858784f None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:00.495252 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08844e87-cd4a-4dc2-abe5-a0bf7858784f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:00.505944 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08844e87-cd4a-4dc2-abe5-a0bf7858784f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:00.510960 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-08844e87-cd4a-4dc2-abe5-a0bf7858784f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 03:51:00.510960 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:00.510960 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:00.510960 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:00.510960 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:00.510960 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:00.510960 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:00.510960 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:00.510960 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:00.510960 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:00.510960 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:00.510960 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:00.510960 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:00.510960 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:00.510960 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:00.510960 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:00.512035 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:00.512035 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:00.512035 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:00.512035 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:00.512035 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:00.512035 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:00.512035 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:00.512035 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:00.512035 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:00.512035 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:00.512035 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:00.512035 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:00.512035 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:00.512035 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:00.512035 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:00.512035 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:00.513083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:00.513083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:00.513083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:00.513083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:00.513083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:00.513083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:00.513083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:00.513083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:00.513083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:00.513083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:00.513083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 03:51:00.513083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:00.515265 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 164/313] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:51:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:00.520068 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773da8e7-ffdc-4c2a-9a25-e68eb05c3ece None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:00.626566 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773da8e7-ffdc-4c2a-9a25-e68eb05c3ece None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:00.662508 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b9002-7165-4865-865b-3cf19823c04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:00.663222 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b9002-7165-4865-865b-3cf19823c04c None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:00.663434 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b9002-7165-4865-865b-3cf19823c04c None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:00.663709 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b9002-7165-4865-865b-3cf19823c04c None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:00.664915 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b9002-7165-4865-865b-3cf19823c04c None admin] RBAC: Adding query filter params (name=reader) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:00.665214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b9002-7165-4865-865b-3cf19823c04c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:00.666571 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b9002-7165-4865-865b-3cf19823c04c None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:00.675387 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 150/314] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 03:51:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:00.681743 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08844e87-cd4a-4dc2-abe5-a0bf7858784f None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:00.783477 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08844e87-cd4a-4dc2-abe5-a0bf7858784f None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:00.820768 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c2f8c-34bc-4d73-a276-0fc30f2abe2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:00.821406 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c2f8c-34bc-4d73-a276-0fc30f2abe2f None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:00.821686 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c2f8c-34bc-4d73-a276-0fc30f2abe2f None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:00.821963 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c2f8c-34bc-4d73-a276-0fc30f2abe2f None admin] PATH_INFO: `/v3/users/08e289a5eecc4b839d55046fca99997a` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:00.823110 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c2f8c-34bc-4d73-a276-0fc30f2abe2f None admin] RBAC: Authorizing `identity:get_user(user_id=08e289a5eecc4b839d55046fca99997a)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:00.824594 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c2f8c-34bc-4d73-a276-0fc30f2abe2f None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:00.826352 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 165/315] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:51:00 2022] GET /identity/v3/users/08e289a5eecc4b839d55046fca99997a => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:00.831877 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b9002-7165-4865-865b-3cf19823c04c None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:00.843704 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:00.941590 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b9002-7165-4865-865b-3cf19823c04c None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:00.976316 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753aa0b-9f73-4fa8-b962-0d81d87f07cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:00.977646 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753aa0b-9f73-4fa8-b962-0d81d87f07cb None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:00.977924 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753aa0b-9f73-4fa8-b962-0d81d87f07cb None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:00.978195 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753aa0b-9f73-4fa8-b962-0d81d87f07cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:01.051402 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6753aa0b-9f73-4fa8-b962-0d81d87f07cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:01.052893 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6753aa0b-9f73-4fa8-b962-0d81d87f07cb None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:01.073606 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:01.162286 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 151/316] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:51:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:51:01.175542 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c2f8c-34bc-4d73-a276-0fc30f2abe2f None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:01.199514 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:01.283062 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c2f8c-34bc-4d73-a276-0fc30f2abe2f None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:01.317082 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d1100-6d0c-4fab-9508-add5c3577310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:01.317897 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d1100-6d0c-4fab-9508-add5c3577310 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:01.318410 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d1100-6d0c-4fab-9508-add5c3577310 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:01.318830 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d1100-6d0c-4fab-9508-add5c3577310 None admin] PATH_INFO: `/v3/projects/a17a7b3783004ebe908993932c90f9d9` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:01.320702 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d1100-6d0c-4fab-9508-add5c3577310 None admin] RBAC: Authorizing `identity:get_project(project_id=a17a7b3783004ebe908993932c90f9d9)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:01.322316 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d1100-6d0c-4fab-9508-add5c3577310 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:01.328581 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 166/317] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:51:01 2022] GET /identity/v3/projects/a17a7b3783004ebe908993932c90f9d9 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:01.333539 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753aa0b-9f73-4fa8-b962-0d81d87f07cb None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:01.434092 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753aa0b-9f73-4fa8-b962-0d81d87f07cb None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:01.443533 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:01.470044 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a810eb2-5366-4bc7-bb1b-07588c6d30c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:01.470576 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a810eb2-5366-4bc7-bb1b-07588c6d30c5 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:01.470849 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a810eb2-5366-4bc7-bb1b-07588c6d30c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:01.471118 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a810eb2-5366-4bc7-bb1b-07588c6d30c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:01.471827 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a810eb2-5366-4bc7-bb1b-07588c6d30c5 None admin] RBAC: Adding query filter params (role.id=97127e19a070494a8ee32407f22bf958, scope.project.id=a17a7b3783004ebe908993932c90f9d9, user.id=08e289a5eecc4b839d55046fca99997a) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:01.472128 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a810eb2-5366-4bc7-bb1b-07588c6d30c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:01.473583 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a810eb2-5366-4bc7-bb1b-07588c6d30c5 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:01.479657 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 152/318] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:51:01 2022] GET /identity/v3/role_assignments?user.id=08e289a5eecc4b839d55046fca99997a&scope.project.id=a17a7b3783004ebe908993932c90f9d9&role.id=97127e19a070494a8ee32407f22bf958 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:02.115697 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa314aec-4e77-4b2d-9530-6baddfebccf1 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:02.116076 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa314aec-4e77-4b2d-9530-6baddfebccf1 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:02.116280 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa314aec-4e77-4b2d-9530-6baddfebccf1 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:02.117787 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 167/319] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:02.122723 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6ce91-b778-45ff-b3ca-79e81c964718 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:02.123172 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6ce91-b778-45ff-b3ca-79e81c964718 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:02.123327 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6ce91-b778-45ff-b3ca-79e81c964718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:02.141788 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-32f6ce91-b778-45ff-b3ca-79e81c964718 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:02.143004 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-32f6ce91-b778-45ff-b3ca-79e81c964718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:02.152674 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96e7f6-f4e7-452b-93fb-fca19585da6c None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:02.152961 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96e7f6-f4e7-452b-93fb-fca19585da6c None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:02.153240 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96e7f6-f4e7-452b-93fb-fca19585da6c None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:02.154816 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 168/320] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 03:51:02.161406 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98365e-b799-43c6-a4bc-7791956c28c4 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:02.162325 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98365e-b799-43c6-a4bc-7791956c28c4 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:02.162837 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98365e-b799-43c6-a4bc-7791956c28c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:02.186388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-0c98365e-b799-43c6-a4bc-7791956c28c4 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:02.187591 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-0c98365e-b799-43c6-a4bc-7791956c28c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:02.221737 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 153/321] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:02.262835 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 169/322] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:02.311979 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25215d0-878b-4007-b9d1-9cf83705511e None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:02.312262 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25215d0-878b-4007-b9d1-9cf83705511e None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:02.312573 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25215d0-878b-4007-b9d1-9cf83705511e None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:02.314047 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 154/323] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:02.318974 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec5b0b-cce0-4e5a-8ae2-363dc5ce9e88 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:02.319255 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec5b0b-cce0-4e5a-8ae2-363dc5ce9e88 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:02.319535 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec5b0b-cce0-4e5a-8ae2-363dc5ce9e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:02.338006 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-9eec5b0b-cce0-4e5a-8ae2-363dc5ce9e88 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:02.339185 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-9eec5b0b-cce0-4e5a-8ae2-363dc5ce9e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:02.352650 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:02.407016 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 170/324] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:02.550021 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25215d0-878b-4007-b9d1-9cf83705511e None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:02.586471 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec5b0b-cce0-4e5a-8ae2-363dc5ce9e88 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:02.660143 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25215d0-878b-4007-b9d1-9cf83705511e None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:02.662464 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:02.694558 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec5b0b-cce0-4e5a-8ae2-363dc5ce9e88 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:02.698958 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704b566-cf02-4e57-aafe-e99b4563924a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:02.699584 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704b566-cf02-4e57-aafe-e99b4563924a None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:02.699865 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704b566-cf02-4e57-aafe-e99b4563924a None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:02.700134 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704b566-cf02-4e57-aafe-e99b4563924a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:02.711434 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704b566-cf02-4e57-aafe-e99b4563924a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:02.716149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-5704b566-cf02-4e57-aafe-e99b4563924a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:51:02.716149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:02.716149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:02.716149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:02.716149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:02.716149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:02.716149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:02.716149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:02.716149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:02.716149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:02.716149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:02.716149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:02.716149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:02.716149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:02.716149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:02.716149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:02.717357 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:02.717357 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:02.717357 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:02.717357 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:02.717357 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:02.717357 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:02.717357 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:02.717357 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:02.717357 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:02.717357 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:02.717357 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:02.717357 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:02.717357 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:02.717357 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:02.717357 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:02.717357 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:02.718848 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:02.718848 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:02.718848 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:02.718848 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:02.718848 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:02.718848 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:02.718848 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:02.718848 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:02.718848 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:02.718848 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:02.718848 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:51:02.718848 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:02.718848 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 155/325] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:51:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:02.722781 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704b566-cf02-4e57-aafe-e99b4563924a None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:02.732713 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da628dd2-4196-4a24-9d3e-699872e6bb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:02.733341 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da628dd2-4196-4a24-9d3e-699872e6bb6a None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:02.733618 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da628dd2-4196-4a24-9d3e-699872e6bb6a None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:02.733890 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da628dd2-4196-4a24-9d3e-699872e6bb6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:02.734994 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da628dd2-4196-4a24-9d3e-699872e6bb6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:02.736450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da628dd2-4196-4a24-9d3e-699872e6bb6a None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:02.738044 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 171/326] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:02.738790 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da628dd2-4196-4a24-9d3e-699872e6bb6a None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:02.756387 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:02.827965 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704b566-cf02-4e57-aafe-e99b4563924a None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:02.836870 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da628dd2-4196-4a24-9d3e-699872e6bb6a None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:02.862296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3ad49-702c-4d3f-8e37-b19e46e47729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:02.862900 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3ad49-702c-4d3f-8e37-b19e46e47729 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:02.863173 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3ad49-702c-4d3f-8e37-b19e46e47729 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:02.863447 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3ad49-702c-4d3f-8e37-b19e46e47729 None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:02.864123 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3ad49-702c-4d3f-8e37-b19e46e47729 None admin] RBAC: Adding query filter params (name=member) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:02.864430 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3ad49-702c-4d3f-8e37-b19e46e47729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:02.865824 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3ad49-702c-4d3f-8e37-b19e46e47729 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:02.870042 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e45f1-4453-4a6f-9025-ce69220abf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:02.870657 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e45f1-4453-4a6f-9025-ce69220abf78 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:02.870932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e45f1-4453-4a6f-9025-ce69220abf78 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:02.871202 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e45f1-4453-4a6f-9025-ce69220abf78 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:02.874335 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 156/327] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 03:51:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:02.875093 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3ad49-702c-4d3f-8e37-b19e46e47729 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:02.885891 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e45f1-4453-4a6f-9025-ce69220abf78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:02.890991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-c53e45f1-4453-4a6f-9025-ce69220abf78 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 03:51:02.890991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:02.890991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:02.890991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:02.890991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:02.890991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:02.890991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:02.890991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:02.890991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:02.890991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:02.890991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:02.890991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:02.890991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:02.890991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:02.890991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:02.890991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:02.892049 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:02.892049 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:02.892049 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:02.892049 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:02.892049 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:02.892049 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:02.892049 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:02.892049 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:02.892049 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:02.892049 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:02.892049 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:02.892049 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:02.892049 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:02.892049 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:02.892049 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:02.892049 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:02.893083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:02.893083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:02.893083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:02.893083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:02.893083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:02.893083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:02.893083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:02.893083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:02.893083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:02.893083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:02.893083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 03:51:02.893083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:02.893083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 172/328] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:51:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:02.893083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e45f1-4453-4a6f-9025-ce69220abf78 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:02.903129 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:02.971313 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:02.983999 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3ad49-702c-4d3f-8e37-b19e46e47729 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:02.994973 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e45f1-4453-4a6f-9025-ce69220abf78 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:03.017929 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcaf5df-5557-46dc-91d8-c80b97eba640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:03.018529 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaf5df-5557-46dc-91d8-c80b97eba640 None admin] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:03.018807 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaf5df-5557-46dc-91d8-c80b97eba640 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:03.019076 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaf5df-5557-46dc-91d8-c80b97eba640 None admin] PATH_INFO: `/v3/groups` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:03.019686 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcaf5df-5557-46dc-91d8-c80b97eba640 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:03.021166 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcaf5df-5557-46dc-91d8-c80b97eba640 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:03.027617 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685e483-c804-4c80-be44-6fdd9e0a573b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:03.028246 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685e483-c804-4c80-be44-6fdd9e0a573b None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:03.028540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685e483-c804-4c80-be44-6fdd9e0a573b None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:03.028814 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685e483-c804-4c80-be44-6fdd9e0a573b None admin] PATH_INFO: `/v3/users/9c6af07957074cb99bc010bb5c7a9def` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:03.030150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685e483-c804-4c80-be44-6fdd9e0a573b None admin] RBAC: Authorizing `identity:get_user(user_id=9c6af07957074cb99bc010bb5c7a9def)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:03.031811 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685e483-c804-4c80-be44-6fdd9e0a573b None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:03.033361 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 173/329] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:51:02 2022] GET /identity/v3/users/9c6af07957074cb99bc010bb5c7a9def => generated 293 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:03.034117 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685e483-c804-4c80-be44-6fdd9e0a573b None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:03.046951 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 157/330] 10.222.0.43 () {60 vars in 1134 bytes} [Fri Aug 19 03:51:02 2022] POST /identity/v3/groups => generated 226 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:51:03.046951 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcaf5df-5557-46dc-91d8-c80b97eba640 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:03.137095 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:03.147140 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685e483-c804-4c80-be44-6fdd9e0a573b None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:03.158542 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcaf5df-5557-46dc-91d8-c80b97eba640 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:03.196272 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d6660-fadc-43c5-9587-67b752660c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:03.196922 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d6660-fadc-43c5-9587-67b752660c47 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:03.197239 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d6660-fadc-43c5-9587-67b752660c47 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:03.197472 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d6660-fadc-43c5-9587-67b752660c47 None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:03.198382 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d6660-fadc-43c5-9587-67b752660c47 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:03.198489 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d6660-fadc-43c5-9587-67b752660c47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:03.199848 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d6660-fadc-43c5-9587-67b752660c47 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:03.203391 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902f93b-5150-45fd-8af4-0c47763fc481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:03.204110 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902f93b-5150-45fd-8af4-0c47763fc481 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:03.204397 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902f93b-5150-45fd-8af4-0c47763fc481 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:03.204719 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902f93b-5150-45fd-8af4-0c47763fc481 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:03.205456 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0902f93b-5150-45fd-8af4-0c47763fc481 None admin] RBAC: Adding query filter params (role.id=eaf433778e9e4d44bf6d1a1ea65d983f, user.id=9c6af07957074cb99bc010bb5c7a9def, scope.system=all) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:03.205769 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0902f93b-5150-45fd-8af4-0c47763fc481 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:03.207228 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0902f93b-5150-45fd-8af4-0c47763fc481 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:03.209504 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 174/331] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 03:51:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:03.215700 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d6660-fadc-43c5-9587-67b752660c47 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:03.221100 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 158/332] 10.222.0.43 () {56 vars in 1308 bytes} [Fri Aug 19 03:51:03 2022] GET /identity/v3/role_assignments?user.id=9c6af07957074cb99bc010bb5c7a9def&scope.system=all&role.id=eaf433778e9e4d44bf6d1a1ea65d983f => generated 510 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:03.226961 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:03.344336 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d6660-fadc-43c5-9587-67b752660c47 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:03.388963 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ab1e1-6cb3-47b1-8210-67baf376b6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:03.389617 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ab1e1-6cb3-47b1-8210-67baf376b6ff None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:03.389898 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ab1e1-6cb3-47b1-8210-67baf376b6ff None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:03.390176 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ab1e1-6cb3-47b1-8210-67baf376b6ff None admin] PATH_INFO: `/v3/users/75af3d2c654d4222ae148c7744293514` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:03.391358 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ab1e1-6cb3-47b1-8210-67baf376b6ff None admin] RBAC: Authorizing `identity:get_user(user_id=75af3d2c654d4222ae148c7744293514)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:03.392893 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ab1e1-6cb3-47b1-8210-67baf376b6ff None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:03.394893 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 175/333] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:51:03 2022] GET /identity/v3/users/75af3d2c654d4222ae148c7744293514 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:03.400700 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902f93b-5150-45fd-8af4-0c47763fc481 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:03.521257 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902f93b-5150-45fd-8af4-0c47763fc481 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:03.562538 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a16c4-fb9c-4ff3-b24b-ec489b13ac11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:03.563195 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a16c4-fb9c-4ff3-b24b-ec489b13ac11 None admin] REQUEST_METHOD: `PUT` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:03.563474 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a16c4-fb9c-4ff3-b24b-ec489b13ac11 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:03.563750 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a16c4-fb9c-4ff3-b24b-ec489b13ac11 None admin] PATH_INFO: `/v3/system/users/75af3d2c654d4222ae148c7744293514/roles/97127e19a070494a8ee32407f22bf958` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:03.566013 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a16c4-fb9c-4ff3-b24b-ec489b13ac11 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=75af3d2c654d4222ae148c7744293514, role_id=97127e19a070494a8ee32407f22bf958)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:03.567386 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a16c4-fb9c-4ff3-b24b-ec489b13ac11 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:03.577387 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 159/334] 10.222.0.43 () {58 vars in 1334 bytes} [Fri Aug 19 03:51:03 2022] PUT /identity/v3/system/users/75af3d2c654d4222ae148c7744293514/roles/97127e19a070494a8ee32407f22bf958 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 03:51:05.494574 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb45da9-5667-43ab-a4f9-9636dbc18a39 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:05.495071 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb45da9-5667-43ab-a4f9-9636dbc18a39 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:05.495149 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb45da9-5667-43ab-a4f9-9636dbc18a39 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:05.496761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 176/335] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:05.502245 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ed401-ddad-4134-91de-002f4eb65415 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:05.502662 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ed401-ddad-4134-91de-002f4eb65415 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:05.502833 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ed401-ddad-4134-91de-002f4eb65415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:05.520871 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:05.532204 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-ad3ed401-ddad-4134-91de-002f4eb65415 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:05.534169 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-ad3ed401-ddad-4134-91de-002f4eb65415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:05.620978 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 160/336] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 03:51:05.961800 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41f883-2b8c-4fa0-8c50-023085d749ba None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:05.962167 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41f883-2b8c-4fa0-8c50-023085d749ba None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:05.962347 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41f883-2b8c-4fa0-8c50-023085d749ba None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:05.964034 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 177/337] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:05.969671 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c9e10-e2a4-4826-907d-1b64f56735b9 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:05.969962 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c9e10-e2a4-4826-907d-1b64f56735b9 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:05.970248 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c9e10-e2a4-4826-907d-1b64f56735b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:05.997617 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-115c9e10-e2a4-4826-907d-1b64f56735b9 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:05.998854 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-115c9e10-e2a4-4826-907d-1b64f56735b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:06.086973 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 161/338] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:06.294596 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc20106-bfb8-49cc-8dcf-4cccf2a8a5d4 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:06.294888 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc20106-bfb8-49cc-8dcf-4cccf2a8a5d4 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:06.295069 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc20106-bfb8-49cc-8dcf-4cccf2a8a5d4 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:06.296416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 178/339] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:06.301918 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e8af6-24b1-4533-b7f0-bd33660cdb9a None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:06.302387 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e8af6-24b1-4533-b7f0-bd33660cdb9a None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:06.302810 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e8af6-24b1-4533-b7f0-bd33660cdb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:06.326040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc20106-bfb8-49cc-8dcf-4cccf2a8a5d4 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:06.327427 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-985e8af6-24b1-4533-b7f0-bd33660cdb9a None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:06.328650 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-985e8af6-24b1-4533-b7f0-bd33660cdb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:06.419600 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:06.432577 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:06.433016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 162/340] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:06.461134 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc20106-bfb8-49cc-8dcf-4cccf2a8a5d4 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:06.517229 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed383fbf-b24a-4a80-97ff-6228183aedc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:06.517873 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed383fbf-b24a-4a80-97ff-6228183aedc8 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:06.518138 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed383fbf-b24a-4a80-97ff-6228183aedc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:06.518412 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed383fbf-b24a-4a80-97ff-6228183aedc8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:06.533328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed383fbf-b24a-4a80-97ff-6228183aedc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:06.539828 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-ed383fbf-b24a-4a80-97ff-6228183aedc8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:51:06.539828 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:06.539828 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:06.539828 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:06.539828 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:06.539828 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:06.539828 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:06.539828 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:06.539828 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:06.539828 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:06.539828 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:06.539828 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:06.539828 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:06.539828 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:06.539828 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:06.539828 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:06.540782 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:06.540782 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:06.540782 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:06.540782 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:06.540782 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:06.540782 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:06.540782 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:06.540782 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:06.540782 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:06.540782 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:06.540782 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:06.540782 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:06.540782 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:06.540782 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:06.540782 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:06.540782 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:06.541624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:06.541624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:06.541624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:06.541624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:06.541624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:06.541624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:06.541624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:06.541624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:06.541624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:06.541624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:06.541624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:51:06.541624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:06.541624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 179/341] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:51:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:06.546813 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e8af6-24b1-4533-b7f0-bd33660cdb9a None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:06.686346 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e8af6-24b1-4533-b7f0-bd33660cdb9a None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:06.726719 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc779739-7a0c-4057-ad03-1ad215b1961b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:06.727702 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc779739-7a0c-4057-ad03-1ad215b1961b None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:06.728192 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc779739-7a0c-4057-ad03-1ad215b1961b None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:06.728715 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc779739-7a0c-4057-ad03-1ad215b1961b None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:06.729659 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc779739-7a0c-4057-ad03-1ad215b1961b None admin] RBAC: Adding query filter params (name=member) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:06.730171 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc779739-7a0c-4057-ad03-1ad215b1961b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:06.731767 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc779739-7a0c-4057-ad03-1ad215b1961b None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:06.740607 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed383fbf-b24a-4a80-97ff-6228183aedc8 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:06.744986 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 163/342] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 03:51:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:06.750408 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc779739-7a0c-4057-ad03-1ad215b1961b None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:06.827314 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:06.881958 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc779739-7a0c-4057-ad03-1ad215b1961b None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:06.920815 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a0971-884f-4c11-a11f-d6cba22870f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:06.921812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a0971-884f-4c11-a11f-d6cba22870f3 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:06.922250 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a0971-884f-4c11-a11f-d6cba22870f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:06.922692 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a0971-884f-4c11-a11f-d6cba22870f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:06.924553 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed383fbf-b24a-4a80-97ff-6228183aedc8 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:06.985163 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738a526-37b4-47ff-86e5-20ec2a6d077d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:06.986092 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738a526-37b4-47ff-86e5-20ec2a6d077d None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:06.986612 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738a526-37b4-47ff-86e5-20ec2a6d077d None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:06.987249 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738a526-37b4-47ff-86e5-20ec2a6d077d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:06.994862 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:06.998962 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a0971-884f-4c11-a11f-d6cba22870f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:07.001348 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a0971-884f-4c11-a11f-d6cba22870f3 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:07.011898 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738a526-37b4-47ff-86e5-20ec2a6d077d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:07.018027 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-5738a526-37b4-47ff-86e5-20ec2a6d077d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:51:07.018027 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:07.018027 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:07.018027 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:07.018027 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:07.018027 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:07.018027 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:07.018027 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:07.018027 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:07.018027 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:07.018027 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:07.018027 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:07.018027 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:07.018027 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:07.018027 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:07.018027 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:07.018974 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:07.018974 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:07.018974 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:07.018974 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:07.018974 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:07.018974 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:07.018974 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:07.018974 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:07.018974 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:07.018974 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:07.018974 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:07.018974 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:07.018974 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:07.018974 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:07.018974 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:07.018974 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:07.019822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:07.019822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:07.019822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:07.019822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:07.019822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:07.019822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:07.019822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:07.019822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:07.019822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:07.019822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:07.019822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:51:07.019822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:07.023227 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 180/343] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:51:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:07.029182 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738a526-37b4-47ff-86e5-20ec2a6d077d None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:07.068084 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:07.120503 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 164/344] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:51:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 03:51:07.120970 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a0971-884f-4c11-a11f-d6cba22870f3 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:07.232997 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a0971-884f-4c11-a11f-d6cba22870f3 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:07.252905 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738a526-37b4-47ff-86e5-20ec2a6d077d None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:07.277216 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac206502-692d-4885-819b-cac3764da2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:07.277860 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac206502-692d-4885-819b-cac3764da2e0 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:07.278137 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac206502-692d-4885-819b-cac3764da2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:07.278408 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac206502-692d-4885-819b-cac3764da2e0 None admin] PATH_INFO: `/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:07.279651 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac206502-692d-4885-819b-cac3764da2e0 None admin] RBAC: Authorizing `identity:get_project(project_id=1cba8bf5387546e18ca3f132b9f78bc1)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:07.281128 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac206502-692d-4885-819b-cac3764da2e0 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:07.287387 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 165/345] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:51:07 2022] GET /identity/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:07.287387 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac206502-692d-4885-819b-cac3764da2e0 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:07.300230 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e988453-df71-417e-968d-e896f0ed6a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:07.301177 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e988453-df71-417e-968d-e896f0ed6a27 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:07.301677 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e988453-df71-417e-968d-e896f0ed6a27 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:07.302156 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e988453-df71-417e-968d-e896f0ed6a27 None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:07.303065 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e988453-df71-417e-968d-e896f0ed6a27 None admin] RBAC: Adding query filter params (name=member) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:07.303606 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e988453-df71-417e-968d-e896f0ed6a27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:07.305231 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e988453-df71-417e-968d-e896f0ed6a27 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:07.315148 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 181/346] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 03:51:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:07.320502 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:07.320967 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e569c-10a5-48bf-8962-9715631f8a10 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:07.321460 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e569c-10a5-48bf-8962-9715631f8a10 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:07.321947 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e569c-10a5-48bf-8962-9715631f8a10 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:07.323680 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 182/347] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:07.324629 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e569c-10a5-48bf-8962-9715631f8a10 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:07.390994 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:07.396791 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac206502-692d-4885-819b-cac3764da2e0 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:07.434599 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72d08d-7f37-4473-8f83-66bbca1f614c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:07.435232 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72d08d-7f37-4473-8f83-66bbca1f614c None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:07.435510 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72d08d-7f37-4473-8f83-66bbca1f614c None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:07.435784 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72d08d-7f37-4473-8f83-66bbca1f614c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:07.442262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e569c-10a5-48bf-8962-9715631f8a10 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:07.448845 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72d08d-7f37-4473-8f83-66bbca1f614c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:07.453911 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-0f72d08d-7f37-4473-8f83-66bbca1f614c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 03:51:07.453911 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:07.453911 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:07.453911 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:07.453911 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:07.453911 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:07.453911 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:07.453911 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:07.453911 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:07.453911 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:07.453911 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:07.453911 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:07.453911 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:07.453911 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:07.453911 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:07.453911 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:07.454883 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:07.454883 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:07.454883 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:07.454883 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:07.454883 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:07.454883 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:07.454883 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:07.454883 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:07.454883 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:07.454883 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:07.454883 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:07.454883 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:07.454883 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:07.454883 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:07.454883 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:07.454883 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:07.455798 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:07.455798 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:07.455798 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:07.455798 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:07.455798 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:07.455798 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:07.455798 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:07.455798 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:07.455798 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:07.455798 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:07.455798 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 03:51:07.455798 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:07.455798 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 166/348] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 03:51:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:07.456840 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82273488-c917-45cc-976b-ec0af6cb7b9e None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:07.457082 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82273488-c917-45cc-976b-ec0af6cb7b9e None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:07.457347 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82273488-c917-45cc-976b-ec0af6cb7b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:07.480131 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-82273488-c917-45cc-976b-ec0af6cb7b9e None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:07.481476 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-82273488-c917-45cc-976b-ec0af6cb7b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:07.483561 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87152f0a-db1d-4de2-9e36-97489e24afcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:07.484516 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87152f0a-db1d-4de2-9e36-97489e24afcf None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:07.485010 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87152f0a-db1d-4de2-9e36-97489e24afcf None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:07.485471 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87152f0a-db1d-4de2-9e36-97489e24afcf None admin] PATH_INFO: `/v3/groups/1d29f1905021425b86961966fdbf8308` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:07.492250 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87152f0a-db1d-4de2-9e36-97489e24afcf None admin] RBAC: Authorizing `identity:get_group(group_id=1d29f1905021425b86961966fdbf8308)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:07.493753 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87152f0a-db1d-4de2-9e36-97489e24afcf None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:07.495672 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 183/349] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 03:51:07 2022] GET /identity/v3/groups/1d29f1905021425b86961966fdbf8308 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:07.496717 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87152f0a-db1d-4de2-9e36-97489e24afcf None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:07.561786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 167/350] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:07.563998 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafb385-74ba-4636-acd6-890bd24fdd5e None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:07.563998 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafb385-74ba-4636-acd6-890bd24fdd5e None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:07.563998 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafb385-74ba-4636-acd6-890bd24fdd5e None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:07.576450 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 168/351] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:07 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:07.576450 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafb385-74ba-4636-acd6-890bd24fdd5e None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:07.604734 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:07.623722 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87152f0a-db1d-4de2-9e36-97489e24afcf None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:07.649038 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:07.666642 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c7062-ffb5-481c-b1e7-07c781fdb04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:07.667258 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c7062-ffb5-481c-b1e7-07c781fdb04e None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:07.667585 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c7062-ffb5-481c-b1e7-07c781fdb04e None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:07.667866 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c7062-ffb5-481c-b1e7-07c781fdb04e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:07.720094 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafb385-74ba-4636-acd6-890bd24fdd5e None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:07.760313 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c7062-ffb5-481c-b1e7-07c781fdb04e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:07.761936 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c7062-ffb5-481c-b1e7-07c781fdb04e None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:07.768802 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5784e-6858-45e3-a403-7d466ae273f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:07.769719 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5784e-6858-45e3-a403-7d466ae273f7 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:07.770201 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5784e-6858-45e3-a403-7d466ae273f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:07.770700 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5784e-6858-45e3-a403-7d466ae273f7 None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:07.772321 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5784e-6858-45e3-a403-7d466ae273f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:07.772869 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5784e-6858-45e3-a403-7d466ae273f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:07.774848 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5784e-6858-45e3-a403-7d466ae273f7 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:07.790968 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 169/352] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:51:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:07.792543 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5784e-6858-45e3-a403-7d466ae273f7 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:07.890569 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 184/353] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:51:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:51:07.892146 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb98cf-7443-4265-9c1d-842b70a8eacf None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:07.892275 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb98cf-7443-4265-9c1d-842b70a8eacf None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:07.892570 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb98cf-7443-4265-9c1d-842b70a8eacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:07.894112 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:07.914518 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-38eb98cf-7443-4265-9c1d-842b70a8eacf None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:07.915864 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-38eb98cf-7443-4265-9c1d-842b70a8eacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:07.923011 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5784e-6858-45e3-a403-7d466ae273f7 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:07.948864 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:07.971806 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cf80a-3473-4476-b29d-3e4112a1e569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:07.972429 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cf80a-3473-4476-b29d-3e4112a1e569 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:07.972855 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cf80a-3473-4476-b29d-3e4112a1e569 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:07.973131 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cf80a-3473-4476-b29d-3e4112a1e569 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:07.973966 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072cf80a-3473-4476-b29d-3e4112a1e569 None admin] RBAC: Adding query filter params (group.id=1d29f1905021425b86961966fdbf8308, role.id=eaf433778e9e4d44bf6d1a1ea65d983f, scope.project.id=1cba8bf5387546e18ca3f132b9f78bc1) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:07.974276 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072cf80a-3473-4476-b29d-3e4112a1e569 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:07.976380 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072cf80a-3473-4476-b29d-3e4112a1e569 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:07.982377 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 170/354] 10.222.0.43 () {56 vars in 1376 bytes} [Fri Aug 19 03:51:07 2022] GET /identity/v3/role_assignments?group.id=1d29f1905021425b86961966fdbf8308&scope.project.id=1cba8bf5387546e18ca3f132b9f78bc1&role.id=eaf433778e9e4d44bf6d1a1ea65d983f => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:07.982959 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cf80a-3473-4476-b29d-3e4112a1e569 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:08.008033 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 185/355] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:08.009495 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb98cf-7443-4265-9c1d-842b70a8eacf None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:08.149202 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cf80a-3473-4476-b29d-3e4112a1e569 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:08.165578 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb98cf-7443-4265-9c1d-842b70a8eacf None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:08.213441 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7ae79-b9ec-46dd-8872-e91ffe8c1a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:08.214079 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7ae79-b9ec-46dd-8872-e91ffe8c1a42 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:08.214360 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7ae79-b9ec-46dd-8872-e91ffe8c1a42 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:08.214633 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7ae79-b9ec-46dd-8872-e91ffe8c1a42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:08.215376 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf643f-fb09-4a3a-944d-29686d1919e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:08.216011 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf643f-fb09-4a3a-944d-29686d1919e8 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:08.216292 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf643f-fb09-4a3a-944d-29686d1919e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:08.216596 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf643f-fb09-4a3a-944d-29686d1919e8 None admin] PATH_INFO: `/v3/projects/a17a7b3783004ebe908993932c90f9d9` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:08.217727 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf643f-fb09-4a3a-944d-29686d1919e8 None admin] RBAC: Authorizing `identity:get_project(project_id=a17a7b3783004ebe908993932c90f9d9)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:08.219201 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf643f-fb09-4a3a-944d-29686d1919e8 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:08.220863 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 186/356] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:51:08 2022] GET /identity/v3/projects/a17a7b3783004ebe908993932c90f9d9 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:08.221629 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf643f-fb09-4a3a-944d-29686d1919e8 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:08.241419 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:08.248870 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:08.307331 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7ae79-b9ec-46dd-8872-e91ffe8c1a42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:08.308853 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7ae79-b9ec-46dd-8872-e91ffe8c1a42 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:08.346114 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf643f-fb09-4a3a-944d-29686d1919e8 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:08.392475 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc18547-da88-47f9-a065-f192d149cc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:08.393192 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc18547-da88-47f9-a065-f192d149cc4d None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:08.393474 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc18547-da88-47f9-a065-f192d149cc4d None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:08.393747 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc18547-da88-47f9-a065-f192d149cc4d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:08.407411 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc18547-da88-47f9-a065-f192d149cc4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:08.413969 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-2dc18547-da88-47f9-a065-f192d149cc4d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 03:51:08.413969 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:08.413969 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:08.413969 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:08.413969 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:08.413969 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:08.413969 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:08.413969 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:08.413969 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:08.413969 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:08.413969 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:08.413969 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:08.413969 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:08.413969 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:08.413969 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:08.413969 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:08.414898 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:08.414898 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:08.414898 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:08.414898 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:08.414898 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:08.414898 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:08.414898 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:08.414898 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:08.414898 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:08.414898 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:08.414898 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:08.414898 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:08.414898 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:08.414898 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:08.414898 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:08.414898 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:08.416184 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:08.416184 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:08.416184 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:08.416184 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:08.416184 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:08.416184 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:08.416184 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:08.416184 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:08.416184 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:08.416184 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:08.416184 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 03:51:08.416184 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:08.416184 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 187/357] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:51:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:08.416922 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc18547-da88-47f9-a065-f192d149cc4d None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:08.433475 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 171/358] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:51:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:51:08.434878 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f54d14-f1ab-46eb-81a2-ed863c5fccde None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:08.435168 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f54d14-f1ab-46eb-81a2-ed863c5fccde None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:08.435441 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f54d14-f1ab-46eb-81a2-ed863c5fccde None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:08.436948 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 172/359] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:08.437764 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f54d14-f1ab-46eb-81a2-ed863c5fccde None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:08.501715 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:08.516034 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:08.551566 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc18547-da88-47f9-a065-f192d149cc4d None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:08.575126 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f54d14-f1ab-46eb-81a2-ed863c5fccde None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:08.592355 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af7ab3-7477-4665-bbc7-1bf4e8cace1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:08.593213 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af7ab3-7477-4665-bbc7-1bf4e8cace1d None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:08.593579 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af7ab3-7477-4665-bbc7-1bf4e8cace1d None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:08.593860 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af7ab3-7477-4665-bbc7-1bf4e8cace1d None admin] PATH_INFO: `/v3/groups/1d29f1905021425b86961966fdbf8308` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:08.594976 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af7ab3-7477-4665-bbc7-1bf4e8cace1d None admin] RBAC: Authorizing `identity:get_group(group_id=1d29f1905021425b86961966fdbf8308)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:08.596720 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af7ab3-7477-4665-bbc7-1bf4e8cace1d None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:08.598287 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 188/360] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 03:51:08 2022] GET /identity/v3/groups/1d29f1905021425b86961966fdbf8308 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:08.599264 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af7ab3-7477-4665-bbc7-1bf4e8cace1d None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:08.624162 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b78394-0b2f-4807-bce0-7c25f0c60dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:08.625120 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b78394-0b2f-4807-bce0-7c25f0c60dc7 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:08.625402 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b78394-0b2f-4807-bce0-7c25f0c60dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:08.625678 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b78394-0b2f-4807-bce0-7c25f0c60dc7 None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:08.626343 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b78394-0b2f-4807-bce0-7c25f0c60dc7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:08.626647 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b78394-0b2f-4807-bce0-7c25f0c60dc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:08.628516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b78394-0b2f-4807-bce0-7c25f0c60dc7 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:08.637457 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 173/361] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 03:51:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:08.638104 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b78394-0b2f-4807-bce0-7c25f0c60dc7 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:08.724144 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af7ab3-7477-4665-bbc7-1bf4e8cace1d None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:08.768113 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b78394-0b2f-4807-bce0-7c25f0c60dc7 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:08.768419 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278923c-6b6c-4620-849b-4283c1f3912d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:08.769063 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278923c-6b6c-4620-849b-4283c1f3912d None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:08.769337 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278923c-6b6c-4620-849b-4283c1f3912d None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:08.769621 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278923c-6b6c-4620-849b-4283c1f3912d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:08.771587 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:08.786628 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278923c-6b6c-4620-849b-4283c1f3912d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:08.791910 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-2278923c-6b6c-4620-849b-4283c1f3912d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 03:51:08.791910 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:08.791910 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:08.791910 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:08.791910 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:08.791910 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:08.791910 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:08.791910 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:08.791910 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:08.791910 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:08.791910 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:08.791910 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:08.791910 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:08.791910 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:08.791910 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:08.791910 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:08.792932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:08.792932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:08.792932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:08.792932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:08.792932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:08.792932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:08.792932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:08.792932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:08.792932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:08.792932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:08.792932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:08.792932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:08.792932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:08.792932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:08.792932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:08.792932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:08.793765 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:08.793765 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:08.793765 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:08.793765 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:08.793765 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:08.793765 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:08.793765 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:08.793765 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:08.793765 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:08.793765 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:08.793765 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 03:51:08.793765 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:08.796371 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 189/362] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 03:51:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:08.797894 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81c993-2b47-4df9-85a3-9fd8cabd8344 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:08.798191 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81c993-2b47-4df9-85a3-9fd8cabd8344 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:08.798448 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81c993-2b47-4df9-85a3-9fd8cabd8344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:08.811894 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:08.821613 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04dccd-37e5-4839-8985-629e0862c3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:08.821613 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04dccd-37e5-4839-8985-629e0862c3a4 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:08.821613 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04dccd-37e5-4839-8985-629e0862c3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:08.822003 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-9d81c993-2b47-4df9-85a3-9fd8cabd8344 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:08.822078 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04dccd-37e5-4839-8985-629e0862c3a4 None admin] PATH_INFO: `/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:08.822078 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04dccd-37e5-4839-8985-629e0862c3a4 None admin] RBAC: Authorizing `identity:get_project(project_id=1cba8bf5387546e18ca3f132b9f78bc1)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:08.822216 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-9d81c993-2b47-4df9-85a3-9fd8cabd8344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:08.822490 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04dccd-37e5-4839-8985-629e0862c3a4 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:08.825051 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 174/363] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:51:08 2022] GET /identity/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:08.826111 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04dccd-37e5-4839-8985-629e0862c3a4 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:08.901854 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 190/364] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:08.902778 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81c993-2b47-4df9-85a3-9fd8cabd8344 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:08.964787 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04dccd-37e5-4839-8985-629e0862c3a4 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:09.018425 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986ac1d-78ea-4c6e-a164-71bc79b6893c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:09.018986 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986ac1d-78ea-4c6e-a164-71bc79b6893c None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:09.019324 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986ac1d-78ea-4c6e-a164-71bc79b6893c None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:09.019877 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986ac1d-78ea-4c6e-a164-71bc79b6893c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:09.020355 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986ac1d-78ea-4c6e-a164-71bc79b6893c None admin] RBAC: Adding query filter params (group.id=1d29f1905021425b86961966fdbf8308, role.id=eaf433778e9e4d44bf6d1a1ea65d983f, scope.project.id=a17a7b3783004ebe908993932c90f9d9) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:09.020744 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986ac1d-78ea-4c6e-a164-71bc79b6893c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:09.022871 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986ac1d-78ea-4c6e-a164-71bc79b6893c None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:09.029087 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 175/365] 10.222.0.43 () {56 vars in 1376 bytes} [Fri Aug 19 03:51:08 2022] GET /identity/v3/role_assignments?group.id=1d29f1905021425b86961966fdbf8308&scope.project.id=a17a7b3783004ebe908993932c90f9d9&role.id=eaf433778e9e4d44bf6d1a1ea65d983f => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:09.029751 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986ac1d-78ea-4c6e-a164-71bc79b6893c None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:09.034320 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81c993-2b47-4df9-85a3-9fd8cabd8344 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:09.072201 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bca6a-381b-450e-b966-d807d7facf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:09.073421 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bca6a-381b-450e-b966-d807d7facf69 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:09.073939 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bca6a-381b-450e-b966-d807d7facf69 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:09.074430 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bca6a-381b-450e-b966-d807d7facf69 None admin] PATH_INFO: `/v3/users/75af3d2c654d4222ae148c7744293514` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:09.075963 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bca6a-381b-450e-b966-d807d7facf69 None admin] RBAC: Authorizing `identity:get_user(user_id=75af3d2c654d4222ae148c7744293514)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:09.077785 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bca6a-381b-450e-b966-d807d7facf69 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:09.081436 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 191/366] 10.222.0.43 () {56 vars in 1177 bytes} [Fri Aug 19 03:51:08 2022] GET /identity/v3/users/75af3d2c654d4222ae148c7744293514 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:09.082621 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bca6a-381b-450e-b966-d807d7facf69 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:09.091841 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:09.106133 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:09.255118 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986ac1d-78ea-4c6e-a164-71bc79b6893c None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:09.302011 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bca6a-381b-450e-b966-d807d7facf69 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:09.313600 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868e571-9fbe-4668-b04f-d165c950ed13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:09.314215 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868e571-9fbe-4668-b04f-d165c950ed13 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:09.314612 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868e571-9fbe-4668-b04f-d165c950ed13 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:09.314884 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868e571-9fbe-4668-b04f-d165c950ed13 None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:09.315549 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868e571-9fbe-4668-b04f-d165c950ed13 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:09.315845 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868e571-9fbe-4668-b04f-d165c950ed13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:09.317377 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868e571-9fbe-4668-b04f-d165c950ed13 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:09.328092 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 176/367] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:51:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:09.334394 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868e571-9fbe-4668-b04f-d165c950ed13 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:09.358718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29810f3-2bc4-4b96-a6cd-5cb93057cb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:09.359672 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29810f3-2bc4-4b96-a6cd-5cb93057cb60 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:09.359958 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29810f3-2bc4-4b96-a6cd-5cb93057cb60 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:09.360505 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29810f3-2bc4-4b96-a6cd-5cb93057cb60 None admin] PATH_INFO: `/v3/groups/1d29f1905021425b86961966fdbf8308` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:09.361999 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29810f3-2bc4-4b96-a6cd-5cb93057cb60 None admin] RBAC: Authorizing `identity:get_group(group_id=1d29f1905021425b86961966fdbf8308)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:09.363527 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29810f3-2bc4-4b96-a6cd-5cb93057cb60 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:09.366411 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 192/368] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 03:51:09 2022] GET /identity/v3/groups/1d29f1905021425b86961966fdbf8308 => generated 226 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:09.367192 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29810f3-2bc4-4b96-a6cd-5cb93057cb60 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:09.467655 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:09.470189 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:09.473068 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868e571-9fbe-4668-b04f-d165c950ed13 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:09.507786 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29810f3-2bc4-4b96-a6cd-5cb93057cb60 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:09.522902 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e22ffb-b9f6-428c-9197-b758c49a3c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:09.523517 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e22ffb-b9f6-428c-9197-b758c49a3c23 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:09.523798 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e22ffb-b9f6-428c-9197-b758c49a3c23 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:09.524075 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e22ffb-b9f6-428c-9197-b758c49a3c23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:09.524838 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e22ffb-b9f6-428c-9197-b758c49a3c23 None admin] RBAC: Adding query filter params (role.id=97127e19a070494a8ee32407f22bf958, user.id=75af3d2c654d4222ae148c7744293514, scope.system=all) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:09.525136 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e22ffb-b9f6-428c-9197-b758c49a3c23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:09.526767 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e22ffb-b9f6-428c-9197-b758c49a3c23 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:09.540907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 177/369] 10.222.0.43 () {56 vars in 1308 bytes} [Fri Aug 19 03:51:09 2022] GET /identity/v3/role_assignments?user.id=75af3d2c654d4222ae148c7744293514&scope.system=all&role.id=97127e19a070494a8ee32407f22bf958 => generated 510 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:09.541752 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e22ffb-b9f6-428c-9197-b758c49a3c23 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:09.562211 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd9d50-98e4-48bb-a2db-ef054f4affcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:09.563652 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd9d50-98e4-48bb-a2db-ef054f4affcf None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:09.564206 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd9d50-98e4-48bb-a2db-ef054f4affcf None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:09.564906 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd9d50-98e4-48bb-a2db-ef054f4affcf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:09.579350 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd9d50-98e4-48bb-a2db-ef054f4affcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:09.585769 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-eddd9d50-98e4-48bb-a2db-ef054f4affcf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:51:09.585769 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:09.585769 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:09.585769 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:09.585769 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:09.585769 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:09.585769 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:09.585769 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:09.585769 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:09.585769 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:09.585769 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:09.585769 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:09.585769 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:09.585769 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:09.585769 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:09.585769 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:09.586951 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:09.586951 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:09.586951 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:09.586951 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:09.586951 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:09.586951 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:09.586951 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:09.586951 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:09.586951 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:09.586951 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:09.586951 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:09.586951 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:09.586951 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:09.586951 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:09.586951 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:09.586951 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:09.587959 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:09.587959 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:09.587959 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:09.587959 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:09.587959 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:09.587959 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:09.587959 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:09.587959 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:09.587959 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:09.587959 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:09.587959 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:51:09.587959 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:09.590574 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 193/370] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 03:51:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:09.593167 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd9d50-98e4-48bb-a2db-ef054f4affcf None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:09.722117 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd9d50-98e4-48bb-a2db-ef054f4affcf None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:09.762353 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:09.770879 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fff1c5-8857-4b3d-a009-e1bfb8d6a596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:09.774004 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e22ffb-b9f6-428c-9197-b758c49a3c23 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:09.774467 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fff1c5-8857-4b3d-a009-e1bfb8d6a596 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:09.774635 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fff1c5-8857-4b3d-a009-e1bfb8d6a596 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:09.774899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fff1c5-8857-4b3d-a009-e1bfb8d6a596 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:09.777194 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fff1c5-8857-4b3d-a009-e1bfb8d6a596 None admin] RBAC: Adding query filter params (group.id=1d29f1905021425b86961966fdbf8308, role.id=99bf21a1487942d3be2b9bdd4483d23e, scope.project.id=1cba8bf5387546e18ca3f132b9f78bc1) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:09.777522 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fff1c5-8857-4b3d-a009-e1bfb8d6a596 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:09.779031 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fff1c5-8857-4b3d-a009-e1bfb8d6a596 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:09.791706 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 194/371] 10.222.0.43 () {56 vars in 1376 bytes} [Fri Aug 19 03:51:09 2022] GET /identity/v3/role_assignments?group.id=1d29f1905021425b86961966fdbf8308&scope.project.id=1cba8bf5387546e18ca3f132b9f78bc1&role.id=99bf21a1487942d3be2b9bdd4483d23e => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:09.794548 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fff1c5-8857-4b3d-a009-e1bfb8d6a596 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:09.886037 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f461f57-2285-4718-aad1-fcd74af38726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:09.886676 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f461f57-2285-4718-aad1-fcd74af38726 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:09.886957 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f461f57-2285-4718-aad1-fcd74af38726 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:09.887235 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f461f57-2285-4718-aad1-fcd74af38726 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:09.926780 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:09.992747 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f461f57-2285-4718-aad1-fcd74af38726 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:09.994441 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f461f57-2285-4718-aad1-fcd74af38726 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:10.049677 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fff1c5-8857-4b3d-a009-e1bfb8d6a596 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:10.125053 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b95d6-e99b-4cd9-9304-4297c1fb6a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:10.125674 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b95d6-e99b-4cd9-9304-4297c1fb6a2d None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:10.125960 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b95d6-e99b-4cd9-9304-4297c1fb6a2d None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:10.126236 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b95d6-e99b-4cd9-9304-4297c1fb6a2d None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:10.126904 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b95d6-e99b-4cd9-9304-4297c1fb6a2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:10.127210 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b95d6-e99b-4cd9-9304-4297c1fb6a2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:10.130558 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b95d6-e99b-4cd9-9304-4297c1fb6a2d None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:10.152527 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 195/372] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:51:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:10.158692 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b95d6-e99b-4cd9-9304-4297c1fb6a2d None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:10.181196 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 178/373] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:51:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:51:10.187260 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f461f57-2285-4718-aad1-fcd74af38726 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:10.255538 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:10.268109 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:10.328516 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b95d6-e99b-4cd9-9304-4297c1fb6a2d None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:10.334199 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f461f57-2285-4718-aad1-fcd74af38726 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:10.374162 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b7336-33b9-40a9-ba77-0aaed3cc0a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:10.374791 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b7336-33b9-40a9-ba77-0aaed3cc0a78 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:10.375144 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b7336-33b9-40a9-ba77-0aaed3cc0a78 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:10.375429 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b7336-33b9-40a9-ba77-0aaed3cc0a78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:10.388291 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ecbfe-a312-42e9-a2b9-f0c5993415e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:10.389414 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ecbfe-a312-42e9-a2b9-f0c5993415e8 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:10.389984 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ecbfe-a312-42e9-a2b9-f0c5993415e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:10.390485 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ecbfe-a312-42e9-a2b9-f0c5993415e8 None admin] PATH_INFO: `/v3/projects/a17a7b3783004ebe908993932c90f9d9` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:10.391922 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ecbfe-a312-42e9-a2b9-f0c5993415e8 None admin] RBAC: Authorizing `identity:get_project(project_id=a17a7b3783004ebe908993932c90f9d9)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:10.393761 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ecbfe-a312-42e9-a2b9-f0c5993415e8 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:10.395905 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 179/374] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:51:10 2022] GET /identity/v3/projects/a17a7b3783004ebe908993932c90f9d9 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:10.401466 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ecbfe-a312-42e9-a2b9-f0c5993415e8 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:10.516069 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b7336-33b9-40a9-ba77-0aaed3cc0a78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:10.518207 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b7336-33b9-40a9-ba77-0aaed3cc0a78 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:10.553003 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ecbfe-a312-42e9-a2b9-f0c5993415e8 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:10.581886 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:10.600597 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df7902-3340-4091-a2a0-1bc9a43879bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:10.601750 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df7902-3340-4091-a2a0-1bc9a43879bb None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:10.603391 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df7902-3340-4091-a2a0-1bc9a43879bb None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:10.603876 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df7902-3340-4091-a2a0-1bc9a43879bb None admin] PATH_INFO: `/v3/groups/1d29f1905021425b86961966fdbf8308` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:10.606173 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df7902-3340-4091-a2a0-1bc9a43879bb None admin] RBAC: Authorizing `identity:get_group(group_id=1d29f1905021425b86961966fdbf8308)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:10.607971 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df7902-3340-4091-a2a0-1bc9a43879bb None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:10.613455 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 180/375] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 03:51:10 2022] GET /identity/v3/groups/1d29f1905021425b86961966fdbf8308 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:10.621246 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df7902-3340-4091-a2a0-1bc9a43879bb None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:10.626916 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:10.696890 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 196/376] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:51:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:51:10.702885 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b7336-33b9-40a9-ba77-0aaed3cc0a78 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:10.805117 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df7902-3340-4091-a2a0-1bc9a43879bb None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:10.848461 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027350b-73a5-4a18-8eab-04e9db632cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:10.850020 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027350b-73a5-4a18-8eab-04e9db632cf3 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:10.850512 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027350b-73a5-4a18-8eab-04e9db632cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:10.850976 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027350b-73a5-4a18-8eab-04e9db632cf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:10.851914 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027350b-73a5-4a18-8eab-04e9db632cf3 None admin] RBAC: Adding query filter params (group.id=1d29f1905021425b86961966fdbf8308, role.id=99bf21a1487942d3be2b9bdd4483d23e, scope.project.id=a17a7b3783004ebe908993932c90f9d9) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:10.852421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027350b-73a5-4a18-8eab-04e9db632cf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:10.854129 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027350b-73a5-4a18-8eab-04e9db632cf3 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:10.858603 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b7336-33b9-40a9-ba77-0aaed3cc0a78 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:10.860783 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 181/377] 10.222.0.43 () {56 vars in 1376 bytes} [Fri Aug 19 03:51:10 2022] GET /identity/v3/role_assignments?group.id=1d29f1905021425b86961966fdbf8308&scope.project.id=a17a7b3783004ebe908993932c90f9d9&role.id=99bf21a1487942d3be2b9bdd4483d23e => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:10.862308 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a4e60-6cdb-464e-bd08-89ae9eab9ae7 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:10.862786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a4e60-6cdb-464e-bd08-89ae9eab9ae7 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:10.863267 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a4e60-6cdb-464e-bd08-89ae9eab9ae7 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:10.864785 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 182/378] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:10.870432 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebe7bb-2ffb-42f4-8602-9e2d2640e9fd None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:10.871086 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebe7bb-2ffb-42f4-8602-9e2d2640e9fd None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:10.871572 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebe7bb-2ffb-42f4-8602-9e2d2640e9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:10.900296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-eeebe7bb-2ffb-42f4-8602-9e2d2640e9fd None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:10.905775 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-eeebe7bb-2ffb-42f4-8602-9e2d2640e9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:10.933217 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaaecf2-0ca7-4a20-b0b1-f6d9f8d60d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:10.933860 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaaecf2-0ca7-4a20-b0b1-f6d9f8d60d73 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:10.936513 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaaecf2-0ca7-4a20-b0b1-f6d9f8d60d73 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:10.936513 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaaecf2-0ca7-4a20-b0b1-f6d9f8d60d73 None admin] PATH_INFO: `/v3/projects/55a24eb901d34f7180f97d4cbef6abef` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:10.936513 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaaecf2-0ca7-4a20-b0b1-f6d9f8d60d73 None admin] RBAC: Authorizing `identity:get_project(project_id=55a24eb901d34f7180f97d4cbef6abef)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:10.937221 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaaecf2-0ca7-4a20-b0b1-f6d9f8d60d73 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:10.939721 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 197/379] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:51:10 2022] GET /identity/v3/projects/55a24eb901d34f7180f97d4cbef6abef => generated 344 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:10.947536 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaaecf2-0ca7-4a20-b0b1-f6d9f8d60d73 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:11.002494 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:11.006854 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:11.045265 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 183/380] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 03:51:11.131498 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaaecf2-0ca7-4a20-b0b1-f6d9f8d60d73 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:11.184007 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d07fba-8645-406e-8c7d-a0a388248966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:11.185060 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d07fba-8645-406e-8c7d-a0a388248966 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:11.185615 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d07fba-8645-406e-8c7d-a0a388248966 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:11.186078 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d07fba-8645-406e-8c7d-a0a388248966 None admin] PATH_INFO: `/v3/groups/28b098f54ce244518ec86d13cadcd903` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:11.194222 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d07fba-8645-406e-8c7d-a0a388248966 None admin] RBAC: Authorizing `identity:get_group(group_id=28b098f54ce244518ec86d13cadcd903)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:11.196053 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d07fba-8645-406e-8c7d-a0a388248966 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:11.198413 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 198/381] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 03:51:10 2022] GET /identity/v3/groups/28b098f54ce244518ec86d13cadcd903 => generated 229 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:11.204056 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeebe7bb-2ffb-42f4-8602-9e2d2640e9fd None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:11.331650 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeebe7bb-2ffb-42f4-8602-9e2d2640e9fd None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:11.370800 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c4a4d-f86b-46eb-8e4d-7e95a70eb9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:11.371756 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c4a4d-f86b-46eb-8e4d-7e95a70eb9c9 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:11.372250 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c4a4d-f86b-46eb-8e4d-7e95a70eb9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:11.372784 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c4a4d-f86b-46eb-8e4d-7e95a70eb9c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:11.373701 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c4a4d-f86b-46eb-8e4d-7e95a70eb9c9 None admin] RBAC: Adding query filter params (group.id=28b098f54ce244518ec86d13cadcd903, role.id=e154509f216e4ae59f74044aa234ddde, scope.project.id=55a24eb901d34f7180f97d4cbef6abef) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:11.374214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c4a4d-f86b-46eb-8e4d-7e95a70eb9c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:11.375924 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c4a4d-f86b-46eb-8e4d-7e95a70eb9c9 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:11.382494 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 184/382] 10.222.0.43 () {56 vars in 1376 bytes} [Fri Aug 19 03:51:11 2022] GET /identity/v3/role_assignments?group.id=28b098f54ce244518ec86d13cadcd903&scope.project.id=55a24eb901d34f7180f97d4cbef6abef&role.id=e154509f216e4ae59f74044aa234ddde => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:11.592694 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d07fba-8645-406e-8c7d-a0a388248966 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:11.719082 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:11.725593 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2d206-8221-42b2-bfe0-d8f5d7a9f24f None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:11.726160 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2d206-8221-42b2-bfe0-d8f5d7a9f24f None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:11.726632 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2d206-8221-42b2-bfe0-d8f5d7a9f24f None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:11.728451 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 185/383] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:11.732503 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d07fba-8645-406e-8c7d-a0a388248966 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:11.734135 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dc94a-ecca-43a2-96e0-59b5099b0e03 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:11.734420 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dc94a-ecca-43a2-96e0-59b5099b0e03 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:11.734694 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dc94a-ecca-43a2-96e0-59b5099b0e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:11.762313 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-533dc94a-ecca-43a2-96e0-59b5099b0e03 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:11.763931 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-533dc94a-ecca-43a2-96e0-59b5099b0e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:11.766840 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81235402-8b8a-4ca4-bc52-7a14fde2243f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:11.767483 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81235402-8b8a-4ca4-bc52-7a14fde2243f None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:11.767765 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81235402-8b8a-4ca4-bc52-7a14fde2243f None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:11.768037 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81235402-8b8a-4ca4-bc52-7a14fde2243f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:11.779092 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81235402-8b8a-4ca4-bc52-7a14fde2243f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:11.783983 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-81235402-8b8a-4ca4-bc52-7a14fde2243f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:51:11.783983 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:11.783983 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:11.783983 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:11.783983 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:11.783983 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:11.783983 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:11.783983 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:11.783983 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:11.783983 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:11.783983 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:11.783983 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:11.783983 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:11.783983 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:11.783983 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:11.783983 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:11.784954 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:11.784954 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:11.784954 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:11.784954 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:11.784954 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:11.784954 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:11.784954 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:11.784954 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:11.784954 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:11.784954 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:11.784954 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:11.784954 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:11.784954 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:11.784954 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:11.784954 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:11.784954 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:11.785784 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:11.785784 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:11.785784 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:11.785784 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:11.785784 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:11.785784 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:11.785784 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:11.785784 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:11.785784 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:11.785784 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:11.785784 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:51:11.785784 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:11.790635 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 199/384] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:51:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:11.791854 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81235402-8b8a-4ca4-bc52-7a14fde2243f None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:11.822622 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:11.862675 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 186/385] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:11.935527 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81235402-8b8a-4ca4-bc52-7a14fde2243f None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:11.977499 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a741d-b826-41f5-8a80-e82fe16cf28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:11.978447 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a741d-b826-41f5-8a80-e82fe16cf28d None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:11.978934 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a741d-b826-41f5-8a80-e82fe16cf28d None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:11.979406 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a741d-b826-41f5-8a80-e82fe16cf28d None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:11.980278 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a741d-b826-41f5-8a80-e82fe16cf28d None admin] RBAC: Adding query filter params (name=member) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:11.980811 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a741d-b826-41f5-8a80-e82fe16cf28d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:11.982538 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a741d-b826-41f5-8a80-e82fe16cf28d None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:11.994032 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 200/386] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 03:51:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:12.000961 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533dc94a-ecca-43a2-96e0-59b5099b0e03 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:12.114031 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533dc94a-ecca-43a2-96e0-59b5099b0e03 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:12.154746 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d569296-7519-4502-848c-094189d98907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:12.155772 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d569296-7519-4502-848c-094189d98907 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:12.156246 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d569296-7519-4502-848c-094189d98907 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:12.158973 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d569296-7519-4502-848c-094189d98907 None admin] PATH_INFO: `/v3/groups/1d29f1905021425b86961966fdbf8308` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:12.160436 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d569296-7519-4502-848c-094189d98907 None admin] RBAC: Authorizing `identity:get_group(group_id=1d29f1905021425b86961966fdbf8308)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:12.162708 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d569296-7519-4502-848c-094189d98907 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:12.164911 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 187/387] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 03:51:11 2022] GET /identity/v3/groups/1d29f1905021425b86961966fdbf8308 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:12.174035 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a741d-b826-41f5-8a80-e82fe16cf28d None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:12.192884 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:12.312421 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a741d-b826-41f5-8a80-e82fe16cf28d None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:12.354730 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c283c37-0e60-40c5-80e6-c96a26695f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:12.355429 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c283c37-0e60-40c5-80e6-c96a26695f81 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:12.355718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c283c37-0e60-40c5-80e6-c96a26695f81 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:12.355996 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c283c37-0e60-40c5-80e6-c96a26695f81 None admin] PATH_INFO: `/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:12.357164 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c283c37-0e60-40c5-80e6-c96a26695f81 None admin] RBAC: Authorizing `identity:get_project(project_id=1cba8bf5387546e18ca3f132b9f78bc1)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:12.358628 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c283c37-0e60-40c5-80e6-c96a26695f81 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:12.360441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 201/388] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:51:12 2022] GET /identity/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:12.366482 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d569296-7519-4502-848c-094189d98907 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:12.388797 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c283c37-0e60-40c5-80e6-c96a26695f81 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:12.431388 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:12.536285 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d569296-7519-4502-848c-094189d98907 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:12.543083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:12.576363 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c283c37-0e60-40c5-80e6-c96a26695f81 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:12.595354 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627cef84-6836-406f-832f-3f305d82427d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:12.596455 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cef84-6836-406f-832f-3f305d82427d None admin] REQUEST_METHOD: `PUT` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:12.596977 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cef84-6836-406f-832f-3f305d82427d None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:12.597447 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cef84-6836-406f-832f-3f305d82427d None admin] PATH_INFO: `/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1/groups/1d29f1905021425b86961966fdbf8308/roles/eaf433778e9e4d44bf6d1a1ea65d983f` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:12.601909 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627cef84-6836-406f-832f-3f305d82427d None admin] RBAC: Authorizing `identity:create_grant(project_id=1cba8bf5387546e18ca3f132b9f78bc1, group_id=1d29f1905021425b86961966fdbf8308, role_id=eaf433778e9e4d44bf6d1a1ea65d983f)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:12.603651 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627cef84-6836-406f-832f-3f305d82427d None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:12.626436 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 188/389] 10.222.0.43 () {58 vars in 1442 bytes} [Fri Aug 19 03:51:12 2022] PUT /identity/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1/groups/1d29f1905021425b86961966fdbf8308/roles/eaf433778e9e4d44bf6d1a1ea65d983f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 03:51:12.639736 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51941441-f91f-4c0e-ad37-b36bcf022281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:12.640821 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51941441-f91f-4c0e-ad37-b36bcf022281 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:12.641302 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51941441-f91f-4c0e-ad37-b36bcf022281 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:12.641826 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51941441-f91f-4c0e-ad37-b36bcf022281 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:12.654051 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51941441-f91f-4c0e-ad37-b36bcf022281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:12.659599 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-51941441-f91f-4c0e-ad37-b36bcf022281 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:51:12.659599 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:12.659599 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:12.659599 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:12.659599 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:12.659599 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:12.659599 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:12.659599 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:12.659599 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:12.659599 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:12.659599 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:12.659599 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:12.659599 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:12.659599 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:12.659599 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:12.659599 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:12.660511 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:12.660511 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:12.660511 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:12.660511 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:12.660511 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:12.660511 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:12.660511 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:12.660511 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:12.660511 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:12.660511 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:12.660511 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:12.660511 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:12.660511 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:12.660511 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:12.660511 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:12.660511 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:12.661360 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:12.661360 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:12.661360 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:12.661360 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:12.661360 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:12.661360 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:12.661360 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:12.661360 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:12.661360 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:12.661360 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:12.661360 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:51:12.661360 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:12.664058 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 202/390] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:51:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 03:51:12.670315 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627cef84-6836-406f-832f-3f305d82427d None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:12.793182 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627cef84-6836-406f-832f-3f305d82427d None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:12.805630 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:12.839578 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb00e0-fec5-4d84-94ec-8ffa71f74aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:12.841030 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb00e0-fec5-4d84-94ec-8ffa71f74aed None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:12.841525 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb00e0-fec5-4d84-94ec-8ffa71f74aed None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:12.841995 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb00e0-fec5-4d84-94ec-8ffa71f74aed None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:12.842867 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb00e0-fec5-4d84-94ec-8ffa71f74aed None admin] RBAC: Adding query filter params (name=member) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:12.843388 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb00e0-fec5-4d84-94ec-8ffa71f74aed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:12.845179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb00e0-fec5-4d84-94ec-8ffa71f74aed None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:12.858231 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 189/391] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 03:51:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:12.864079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51941441-f91f-4c0e-ad37-b36bcf022281 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:12.878136 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f5869-dce2-4953-8718-339540171805 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:12.878819 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f5869-dce2-4953-8718-339540171805 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:12.883681 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f5869-dce2-4953-8718-339540171805 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:12.887270 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 190/392] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:12 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:12.891293 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824b92f-cf85-4490-afa4-012dda7f58fa None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:12.891810 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824b92f-cf85-4490-afa4-012dda7f58fa None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:12.892280 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824b92f-cf85-4490-afa4-012dda7f58fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:12.930699 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-8824b92f-cf85-4490-afa4-012dda7f58fa None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:12.932754 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-8824b92f-cf85-4490-afa4-012dda7f58fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:13.032265 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 191/393] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 03:51:13.045628 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51941441-f91f-4c0e-ad37-b36bcf022281 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:13.096973 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1428a63-093c-4075-8e2b-a40103e1f534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:13.097514 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1428a63-093c-4075-8e2b-a40103e1f534 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:13.097800 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1428a63-093c-4075-8e2b-a40103e1f534 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:13.098082 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1428a63-093c-4075-8e2b-a40103e1f534 None admin] PATH_INFO: `/v3/groups/1d29f1905021425b86961966fdbf8308` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:13.105145 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1428a63-093c-4075-8e2b-a40103e1f534 None admin] RBAC: Authorizing `identity:get_group(group_id=1d29f1905021425b86961966fdbf8308)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:13.106625 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1428a63-093c-4075-8e2b-a40103e1f534 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:13.108697 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 203/394] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 03:51:12 2022] GET /identity/v3/groups/1d29f1905021425b86961966fdbf8308 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:13.114323 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824b92f-cf85-4490-afa4-012dda7f58fa None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:13.244344 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:13.247892 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824b92f-cf85-4490-afa4-012dda7f58fa None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:13.287225 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cde06-70a5-4d83-b2ed-355316307111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:13.288227 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cde06-70a5-4d83-b2ed-355316307111 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:13.288751 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cde06-70a5-4d83-b2ed-355316307111 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:13.289221 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cde06-70a5-4d83-b2ed-355316307111 None admin] PATH_INFO: `/v3/projects/a17a7b3783004ebe908993932c90f9d9` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:13.290555 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5cde06-70a5-4d83-b2ed-355316307111 None admin] RBAC: Authorizing `identity:get_project(project_id=a17a7b3783004ebe908993932c90f9d9)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:13.292221 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5cde06-70a5-4d83-b2ed-355316307111 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:13.294487 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 192/395] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:51:13 2022] GET /identity/v3/projects/a17a7b3783004ebe908993932c90f9d9 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:13.305533 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1428a63-093c-4075-8e2b-a40103e1f534 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:13.322874 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:13.433206 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1428a63-093c-4075-8e2b-a40103e1f534 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:13.478258 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cde06-70a5-4d83-b2ed-355316307111 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:13.481998 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ca100-9843-4c5a-84bb-e9b918cc5c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:13.482836 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ca100-9843-4c5a-84bb-e9b918cc5c84 None admin] REQUEST_METHOD: `PUT` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:13.483259 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ca100-9843-4c5a-84bb-e9b918cc5c84 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:13.483673 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ca100-9843-4c5a-84bb-e9b918cc5c84 None admin] PATH_INFO: `/v3/projects/a17a7b3783004ebe908993932c90f9d9/groups/1d29f1905021425b86961966fdbf8308/roles/eaf433778e9e4d44bf6d1a1ea65d983f` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:13.485767 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ca100-9843-4c5a-84bb-e9b918cc5c84 None admin] RBAC: Authorizing `identity:create_grant(project_id=a17a7b3783004ebe908993932c90f9d9, group_id=1d29f1905021425b86961966fdbf8308, role_id=eaf433778e9e4d44bf6d1a1ea65d983f)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:13.487364 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ca100-9843-4c5a-84bb-e9b918cc5c84 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:13.511891 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 204/396] 10.222.0.43 () {58 vars in 1442 bytes} [Fri Aug 19 03:51:13 2022] PUT /identity/v3/projects/a17a7b3783004ebe908993932c90f9d9/groups/1d29f1905021425b86961966fdbf8308/roles/eaf433778e9e4d44bf6d1a1ea65d983f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 03:51:13.637808 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cde06-70a5-4d83-b2ed-355316307111 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:13.695704 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab387e8d-8de2-4005-b696-3c7a68da9196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:13.696320 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab387e8d-8de2-4005-b696-3c7a68da9196 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:13.696627 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab387e8d-8de2-4005-b696-3c7a68da9196 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:13.696898 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab387e8d-8de2-4005-b696-3c7a68da9196 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:13.713010 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab387e8d-8de2-4005-b696-3c7a68da9196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:13.717817 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-ab387e8d-8de2-4005-b696-3c7a68da9196 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 03:51:13.717817 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:13.717817 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:13.717817 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:13.717817 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:13.717817 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:13.717817 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:13.717817 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:13.717817 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:13.717817 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:13.717817 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:13.717817 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:13.717817 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:13.717817 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:13.717817 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:13.717817 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:13.718708 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:13.718708 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:13.718708 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:13.718708 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:13.718708 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:13.718708 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:13.718708 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:13.718708 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:13.718708 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:13.718708 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:13.718708 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:13.718708 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:13.718708 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:13.718708 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:13.718708 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:13.718708 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:13.719922 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:13.719922 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:13.719922 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:13.719922 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:13.719922 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:13.719922 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:13.719922 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:13.719922 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:13.719922 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:13.719922 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:13.719922 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 03:51:13.719922 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:13.719922 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 193/397] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 03:51:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 03:51:13.725602 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ca100-9843-4c5a-84bb-e9b918cc5c84 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:13.801626 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:13.845204 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ca100-9843-4c5a-84bb-e9b918cc5c84 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:13.897823 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03b515-3b5e-4576-888a-78fd68354f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:13.898454 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03b515-3b5e-4576-888a-78fd68354f76 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:13.898735 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03b515-3b5e-4576-888a-78fd68354f76 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:13.899009 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03b515-3b5e-4576-888a-78fd68354f76 None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:13.899733 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03b515-3b5e-4576-888a-78fd68354f76 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:13.900045 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03b515-3b5e-4576-888a-78fd68354f76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:13.901526 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03b515-3b5e-4576-888a-78fd68354f76 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:13.909890 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a027c8-5e34-4b63-8daa-70ed01fa1e91 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:13.910373 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a027c8-5e34-4b63-8daa-70ed01fa1e91 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:13.911000 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a027c8-5e34-4b63-8daa-70ed01fa1e91 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:13.912573 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 194/398] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 03:51:13.917414 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4be32d-9295-4278-8f2c-fd23c11c6d2f None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:13.917695 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4be32d-9295-4278-8f2c-fd23c11c6d2f None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:13.917970 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4be32d-9295-4278-8f2c-fd23c11c6d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:13.918288 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 205/399] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:51:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:13.923881 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03b515-3b5e-4576-888a-78fd68354f76 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:13.950667 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-9d4be32d-9295-4278-8f2c-fd23c11c6d2f None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:13.951780 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-9d4be32d-9295-4278-8f2c-fd23c11c6d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:14.000848 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:14.075601 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 195/400] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:14.101876 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03b515-3b5e-4576-888a-78fd68354f76 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:14.144895 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:14.152818 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d776c-f58e-4a50-8dc8-c7804b44be28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:14.153472 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d776c-f58e-4a50-8dc8-c7804b44be28 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:14.153798 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d776c-f58e-4a50-8dc8-c7804b44be28 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:14.154076 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d776c-f58e-4a50-8dc8-c7804b44be28 None admin] PATH_INFO: `/v3/groups/1d29f1905021425b86961966fdbf8308` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:14.155311 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d776c-f58e-4a50-8dc8-c7804b44be28 None admin] RBAC: Authorizing `identity:get_group(group_id=1d29f1905021425b86961966fdbf8308)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:14.156807 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d776c-f58e-4a50-8dc8-c7804b44be28 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:14.158848 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 206/401] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 03:51:13 2022] GET /identity/v3/groups/1d29f1905021425b86961966fdbf8308 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:14.164522 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4be32d-9295-4278-8f2c-fd23c11c6d2f None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:14.314277 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4be32d-9295-4278-8f2c-fd23c11c6d2f None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:14.366257 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e2a8c-beea-456b-9ba1-ef094adc6940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:14.366899 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e2a8c-beea-456b-9ba1-ef094adc6940 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:14.367174 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e2a8c-beea-456b-9ba1-ef094adc6940 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:14.367443 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e2a8c-beea-456b-9ba1-ef094adc6940 None admin] PATH_INFO: `/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:14.368585 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e2a8c-beea-456b-9ba1-ef094adc6940 None admin] RBAC: Authorizing `identity:get_project(project_id=1cba8bf5387546e18ca3f132b9f78bc1)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:14.370017 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e2a8c-beea-456b-9ba1-ef094adc6940 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:14.371628 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 196/402] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:51:14 2022] GET /identity/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:14.377506 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d776c-f58e-4a50-8dc8-c7804b44be28 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:14.431144 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13555e52-7995-444f-8644-83cb00cda7f6 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:14.431443 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13555e52-7995-444f-8644-83cb00cda7f6 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:14.431686 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13555e52-7995-444f-8644-83cb00cda7f6 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:14.433057 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 197/403] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 03:51:14.446037 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ba38c-c51b-4ee7-9985-696a5e3742c1 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:14.446322 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ba38c-c51b-4ee7-9985-696a5e3742c1 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:14.446600 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ba38c-c51b-4ee7-9985-696a5e3742c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:14.479371 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-c57ba38c-c51b-4ee7-9985-696a5e3742c1 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:14.480593 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-c57ba38c-c51b-4ee7-9985-696a5e3742c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:14.498089 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d776c-f58e-4a50-8dc8-c7804b44be28 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:14.515362 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:14.544836 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e569a4-ab49-448c-9311-f6a6f858c4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:14.545492 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e569a4-ab49-448c-9311-f6a6f858c4ea None admin] REQUEST_METHOD: `PUT` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:14.545769 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e569a4-ab49-448c-9311-f6a6f858c4ea None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:14.546043 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e569a4-ab49-448c-9311-f6a6f858c4ea None admin] PATH_INFO: `/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1/groups/1d29f1905021425b86961966fdbf8308/roles/99bf21a1487942d3be2b9bdd4483d23e` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:14.548268 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e569a4-ab49-448c-9311-f6a6f858c4ea None admin] RBAC: Authorizing `identity:create_grant(project_id=1cba8bf5387546e18ca3f132b9f78bc1, group_id=1d29f1905021425b86961966fdbf8308, role_id=99bf21a1487942d3be2b9bdd4483d23e)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:14.549843 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e569a4-ab49-448c-9311-f6a6f858c4ea None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:14.568879 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 207/404] 10.222.0.43 () {58 vars in 1442 bytes} [Fri Aug 19 03:51:14 2022] PUT /identity/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1/groups/1d29f1905021425b86961966fdbf8308/roles/99bf21a1487942d3be2b9bdd4483d23e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 03:51:14.571439 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 198/405] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:14.580228 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e569a4-ab49-448c-9311-f6a6f858c4ea None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:14.674275 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:14.731155 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e569a4-ab49-448c-9311-f6a6f858c4ea None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:14.784737 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70dc60-a057-4b7c-94f5-61ea46b8b68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:14.785806 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70dc60-a057-4b7c-94f5-61ea46b8b68a None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:14.786832 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70dc60-a057-4b7c-94f5-61ea46b8b68a None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:14.787303 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70dc60-a057-4b7c-94f5-61ea46b8b68a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:14.805232 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70dc60-a057-4b7c-94f5-61ea46b8b68a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:14.811216 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-ac70dc60-a057-4b7c-94f5-61ea46b8b68a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 03:51:14.811216 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:14.811216 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:14.811216 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:14.811216 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:14.811216 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:14.811216 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:14.811216 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:14.811216 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:14.811216 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:14.811216 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:14.811216 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:14.811216 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:14.811216 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:14.811216 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:14.811216 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:14.812197 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:14.812197 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:14.812197 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:14.812197 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:14.812197 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:14.812197 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:14.812197 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:14.812197 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:14.812197 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:14.812197 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:14.812197 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:14.812197 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:14.812197 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:14.812197 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:14.812197 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:14.812197 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:14.813126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:14.813126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:14.813126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:14.813126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:14.813126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:14.813126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:14.813126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:14.813126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:14.813126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:14.813126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:14.813126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 03:51:14.813126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:14.815511 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 208/406] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 03:51:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:14.821735 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ba38c-c51b-4ee7-9985-696a5e3742c1 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:14.919801 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70dc60-a057-4b7c-94f5-61ea46b8b68a None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:14.959587 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ba38c-c51b-4ee7-9985-696a5e3742c1 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:15.029292 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70dc60-a057-4b7c-94f5-61ea46b8b68a None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:15.055555 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9892c-136d-4634-bbe8-17d4331530a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:15.056418 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9892c-136d-4634-bbe8-17d4331530a5 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:15.056859 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9892c-136d-4634-bbe8-17d4331530a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:15.057267 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9892c-136d-4634-bbe8-17d4331530a5 None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:15.058105 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9892c-136d-4634-bbe8-17d4331530a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:15.058552 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9892c-136d-4634-bbe8-17d4331530a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:15.060076 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9892c-136d-4634-bbe8-17d4331530a5 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:15.064877 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:15.067250 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397db45a-76ca-4751-850a-f7d56630407f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:15.068970 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397db45a-76ca-4751-850a-f7d56630407f None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:15.069463 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397db45a-76ca-4751-850a-f7d56630407f None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:15.069975 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397db45a-76ca-4751-850a-f7d56630407f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:15.081525 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397db45a-76ca-4751-850a-f7d56630407f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:15.083869 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 199/407] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:51:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:15.088029 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-397db45a-76ca-4751-850a-f7d56630407f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:51:15.088029 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:15.088029 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:15.088029 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:15.088029 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:15.088029 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:15.088029 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:15.088029 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:15.088029 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:15.088029 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:15.088029 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:15.088029 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:15.088029 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:15.088029 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:15.088029 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:15.088029 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:15.089155 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:15.089155 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:15.089155 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:15.089155 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:15.089155 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:15.089155 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:15.089155 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:15.089155 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:15.089155 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:15.089155 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:15.089155 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:15.089155 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:15.089155 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:15.089155 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:15.089155 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:15.089155 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:15.090186 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:15.090186 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:15.090186 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:15.090186 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:15.090186 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:15.090186 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:15.090186 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:15.090186 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:15.090186 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:15.090186 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:15.090186 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:51:15.090186 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:15.091574 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9892c-136d-4634-bbe8-17d4331530a5 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:15.096617 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 209/408] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 03:51:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:15.107969 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397db45a-76ca-4751-850a-f7d56630407f None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:15.137248 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:15.296083 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9892c-136d-4634-bbe8-17d4331530a5 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:15.301299 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397db45a-76ca-4751-850a-f7d56630407f None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:15.350032 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ef1d2-32b8-4edb-8e5e-9b4762c3c9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:15.350585 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ef1d2-32b8-4edb-8e5e-9b4762c3c9b7 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:15.350865 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ef1d2-32b8-4edb-8e5e-9b4762c3c9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:15.351142 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ef1d2-32b8-4edb-8e5e-9b4762c3c9b7 None admin] PATH_INFO: `/v3/groups/1d29f1905021425b86961966fdbf8308` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:15.354960 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ef1d2-32b8-4edb-8e5e-9b4762c3c9b7 None admin] RBAC: Authorizing `identity:get_group(group_id=1d29f1905021425b86961966fdbf8308)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:15.356409 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ef1d2-32b8-4edb-8e5e-9b4762c3c9b7 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:15.358200 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 200/409] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 03:51:15 2022] GET /identity/v3/groups/1d29f1905021425b86961966fdbf8308 => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:15.365269 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ef1d2-32b8-4edb-8e5e-9b4762c3c9b7 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:15.367426 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d63f66-9b06-4173-827a-61f21f7b910f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:15.368043 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d63f66-9b06-4173-827a-61f21f7b910f None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:15.368321 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d63f66-9b06-4173-827a-61f21f7b910f None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:15.368623 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d63f66-9b06-4173-827a-61f21f7b910f None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:15.369298 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d63f66-9b06-4173-827a-61f21f7b910f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:15.369603 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d63f66-9b06-4173-827a-61f21f7b910f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:15.373084 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d63f66-9b06-4173-827a-61f21f7b910f None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:15.389945 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 210/410] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:51:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:15.398147 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d63f66-9b06-4173-827a-61f21f7b910f None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:15.457005 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:15.506275 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:15.525235 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ef1d2-32b8-4edb-8e5e-9b4762c3c9b7 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:15.531796 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d63f66-9b06-4173-827a-61f21f7b910f None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:15.564019 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81640d-559d-4c42-977c-32544f72b18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:15.564814 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81640d-559d-4c42-977c-32544f72b18c None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:15.565102 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81640d-559d-4c42-977c-32544f72b18c None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:15.565380 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81640d-559d-4c42-977c-32544f72b18c None admin] PATH_INFO: `/v3/projects/a17a7b3783004ebe908993932c90f9d9` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:15.566731 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81640d-559d-4c42-977c-32544f72b18c None admin] RBAC: Authorizing `identity:get_project(project_id=a17a7b3783004ebe908993932c90f9d9)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:15.568342 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81640d-559d-4c42-977c-32544f72b18c None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:15.571310 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 201/411] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:51:15 2022] GET /identity/v3/projects/a17a7b3783004ebe908993932c90f9d9 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:15.572613 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89112e35-7842-48b3-9cbc-ca85df43465e None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:15.572900 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89112e35-7842-48b3-9cbc-ca85df43465e None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:15.573174 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89112e35-7842-48b3-9cbc-ca85df43465e None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:15.573670 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69589361-80f8-4afc-909c-57a3dd21ad4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:15.574309 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69589361-80f8-4afc-909c-57a3dd21ad4d None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:15.574591 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69589361-80f8-4afc-909c-57a3dd21ad4d None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:15.574870 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69589361-80f8-4afc-909c-57a3dd21ad4d None admin] PATH_INFO: `/v3/groups/28b098f54ce244518ec86d13cadcd903` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:15.576066 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69589361-80f8-4afc-909c-57a3dd21ad4d None admin] RBAC: Authorizing `identity:get_group(group_id=28b098f54ce244518ec86d13cadcd903)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:15.577656 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69589361-80f8-4afc-909c-57a3dd21ad4d None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:15.578603 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 202/412] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:15.579392 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89112e35-7842-48b3-9cbc-ca85df43465e None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:15.584398 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 211/413] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 03:51:15 2022] GET /identity/v3/groups/28b098f54ce244518ec86d13cadcd903 => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:15.586580 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f39e6-f5de-4a9f-bf66-cadcbe7a1726 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:15.586874 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f39e6-f5de-4a9f-bf66-cadcbe7a1726 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:15.587157 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f39e6-f5de-4a9f-bf66-cadcbe7a1726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:15.607807 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-ff5f39e6-f5de-4a9f-bf66-cadcbe7a1726 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:15.608963 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-ff5f39e6-f5de-4a9f-bf66-cadcbe7a1726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:15.679247 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 212/414] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:15.680112 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f39e6-f5de-4a9f-bf66-cadcbe7a1726 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:15.722387 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89112e35-7842-48b3-9cbc-ca85df43465e None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:15.731692 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:15.789000 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c123bd3-0623-4480-8982-4126a4121f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:15.789785 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c123bd3-0623-4480-8982-4126a4121f00 None admin] REQUEST_METHOD: `PUT` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:15.790071 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c123bd3-0623-4480-8982-4126a4121f00 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:15.790352 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c123bd3-0623-4480-8982-4126a4121f00 None admin] PATH_INFO: `/v3/projects/a17a7b3783004ebe908993932c90f9d9/groups/1d29f1905021425b86961966fdbf8308/roles/99bf21a1487942d3be2b9bdd4483d23e` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:15.795012 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c123bd3-0623-4480-8982-4126a4121f00 None admin] RBAC: Authorizing `identity:create_grant(project_id=a17a7b3783004ebe908993932c90f9d9, group_id=1d29f1905021425b86961966fdbf8308, role_id=99bf21a1487942d3be2b9bdd4483d23e)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:15.796258 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f39e6-f5de-4a9f-bf66-cadcbe7a1726 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:15.796723 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c123bd3-0623-4480-8982-4126a4121f00 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:15.823149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 203/415] 10.222.0.43 () {58 vars in 1442 bytes} [Fri Aug 19 03:51:15 2022] PUT /identity/v3/projects/a17a7b3783004ebe908993932c90f9d9/groups/1d29f1905021425b86961966fdbf8308/roles/99bf21a1487942d3be2b9bdd4483d23e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 03:51:15.834728 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8921c2-d830-49e3-a72b-25ee8de85853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:15.835657 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8921c2-d830-49e3-a72b-25ee8de85853 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:15.836133 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8921c2-d830-49e3-a72b-25ee8de85853 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:15.836625 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8921c2-d830-49e3-a72b-25ee8de85853 None admin] PATH_INFO: `/v3/projects/55a24eb901d34f7180f97d4cbef6abef` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:15.837984 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8921c2-d830-49e3-a72b-25ee8de85853 None admin] RBAC: Authorizing `identity:get_project(project_id=55a24eb901d34f7180f97d4cbef6abef)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:15.839590 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8921c2-d830-49e3-a72b-25ee8de85853 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:15.846663 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 213/416] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:51:15 2022] GET /identity/v3/projects/55a24eb901d34f7180f97d4cbef6abef => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:15.848878 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c123bd3-0623-4480-8982-4126a4121f00 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:15.875718 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:16.020981 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c123bd3-0623-4480-8982-4126a4121f00 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:16.071483 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d99e2-1951-41f6-9025-1010c686f3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:16.072189 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d99e2-1951-41f6-9025-1010c686f3de None admin] REQUEST_METHOD: `PUT` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:16.072472 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d99e2-1951-41f6-9025-1010c686f3de None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:16.072815 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d99e2-1951-41f6-9025-1010c686f3de None admin] PATH_INFO: `/v3/projects/55a24eb901d34f7180f97d4cbef6abef/groups/28b098f54ce244518ec86d13cadcd903/roles/e154509f216e4ae59f74044aa234ddde` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:16.076084 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d99e2-1951-41f6-9025-1010c686f3de None admin] RBAC: Authorizing `identity:create_grant(project_id=55a24eb901d34f7180f97d4cbef6abef, group_id=28b098f54ce244518ec86d13cadcd903, role_id=e154509f216e4ae59f74044aa234ddde)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:16.077576 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d99e2-1951-41f6-9025-1010c686f3de None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:16.094705 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 204/417] 10.222.0.43 () {58 vars in 1442 bytes} [Fri Aug 19 03:51:15 2022] PUT /identity/v3/projects/55a24eb901d34f7180f97d4cbef6abef/groups/28b098f54ce244518ec86d13cadcd903/roles/e154509f216e4ae59f74044aa234ddde => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 03:51:16.220022 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8921c2-d830-49e3-a72b-25ee8de85853 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:16.341990 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39458bab-293c-4a9a-bcbb-a0ccef1e9741 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:16.342269 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39458bab-293c-4a9a-bcbb-a0ccef1e9741 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:16.342546 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39458bab-293c-4a9a-bcbb-a0ccef1e9741 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:16.343902 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 205/418] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 03:51:16.352507 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8921c2-d830-49e3-a72b-25ee8de85853 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:16.352691 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fc59f-e50c-404b-9f41-e923ddf7f58d None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:16.352691 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fc59f-e50c-404b-9f41-e923ddf7f58d None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:16.352691 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fc59f-e50c-404b-9f41-e923ddf7f58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:16.364391 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:16.374282 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-105fc59f-e50c-404b-9f41-e923ddf7f58d None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:16.375470 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-105fc59f-e50c-404b-9f41-e923ddf7f58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:16.392706 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f0938-7e86-4cb5-9adb-fa0e5e8dbefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:16.393613 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f0938-7e86-4cb5-9adb-fa0e5e8dbefc None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:16.394093 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f0938-7e86-4cb5-9adb-fa0e5e8dbefc None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:16.394540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f0938-7e86-4cb5-9adb-fa0e5e8dbefc None admin] PATH_INFO: `/v3/roles/member` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:16.406508 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f0938-7e86-4cb5-9adb-fa0e5e8dbefc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:16.411819 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-2c8f0938-7e86-4cb5-9adb-fa0e5e8dbefc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:51:16.411819 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:16.411819 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:16.411819 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:16.411819 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:16.411819 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:16.411819 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:16.411819 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:16.411819 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:16.411819 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:16.411819 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:16.411819 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:16.411819 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:16.411819 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:16.411819 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:16.411819 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:16.412744 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:16.412744 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:16.412744 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:16.412744 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:16.412744 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:16.412744 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:16.412744 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:16.412744 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:16.412744 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:16.412744 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:16.412744 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:16.412744 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:16.412744 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:16.412744 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:16.412744 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:16.412744 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:16.413555 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:16.413555 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:16.413555 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:16.413555 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:16.413555 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:16.413555 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:16.413555 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:16.413555 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:16.413555 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:16.413555 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:16.413555 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:51:16.413555 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:16.414246 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 214/419] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:51:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:16.420605 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f0938-7e86-4cb5-9adb-fa0e5e8dbefc None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:16.460265 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 206/420] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:16.591215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f0938-7e86-4cb5-9adb-fa0e5e8dbefc None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:16.633919 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4134de6-4856-4d8f-badc-0a6ef9991191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:16.634518 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4134de6-4856-4d8f-badc-0a6ef9991191 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:16.634793 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4134de6-4856-4d8f-badc-0a6ef9991191 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:16.635064 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4134de6-4856-4d8f-badc-0a6ef9991191 None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:16.635717 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4134de6-4856-4d8f-badc-0a6ef9991191 None admin] RBAC: Adding query filter params (name=member) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:16.636135 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4134de6-4856-4d8f-badc-0a6ef9991191 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:16.637554 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4134de6-4856-4d8f-badc-0a6ef9991191 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:16.652401 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 215/421] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 03:51:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:16.658128 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105fc59f-e50c-404b-9f41-e923ddf7f58d None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:16.661780 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:16.795267 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105fc59f-e50c-404b-9f41-e923ddf7f58d None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:16.833463 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9083c-6f16-485e-b4fc-686876daa9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:16.834078 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9083c-6f16-485e-b4fc-686876daa9e5 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:16.834357 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9083c-6f16-485e-b4fc-686876daa9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:16.834633 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9083c-6f16-485e-b4fc-686876daa9e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:16.905631 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9083c-6f16-485e-b4fc-686876daa9e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:16.907158 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9083c-6f16-485e-b4fc-686876daa9e5 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:16.909906 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:17.010280 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 207/422] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:51:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:51:17.015778 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4134de6-4856-4d8f-badc-0a6ef9991191 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:17.083268 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:17.083923 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9083c-6f16-485e-b4fc-686876daa9e5 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:17.199178 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4134de6-4856-4d8f-badc-0a6ef9991191 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:17.240306 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d84780-0580-4509-a4dc-b9405176f065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:17.242440 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d84780-0580-4509-a4dc-b9405176f065 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:17.243096 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d84780-0580-4509-a4dc-b9405176f065 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:17.244953 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d84780-0580-4509-a4dc-b9405176f065 None admin] PATH_INFO: `/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:17.247227 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d84780-0580-4509-a4dc-b9405176f065 None admin] RBAC: Authorizing `identity:get_project(project_id=1cba8bf5387546e18ca3f132b9f78bc1)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:17.249986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d84780-0580-4509-a4dc-b9405176f065 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:17.251990 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 216/423] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:51:17 2022] GET /identity/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:17.262104 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d84780-0580-4509-a4dc-b9405176f065 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:17.296089 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9083c-6f16-485e-b4fc-686876daa9e5 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:17.301030 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:17.341032 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b747e3-d7d4-4599-8192-90ffc8ec31e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:17.341981 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b747e3-d7d4-4599-8192-90ffc8ec31e5 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:17.342454 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b747e3-d7d4-4599-8192-90ffc8ec31e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:17.342921 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b747e3-d7d4-4599-8192-90ffc8ec31e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:17.354375 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b747e3-d7d4-4599-8192-90ffc8ec31e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:17.359497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-76b747e3-d7d4-4599-8192-90ffc8ec31e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:51:17.359497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:17.359497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:17.359497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:17.359497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:17.359497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:17.359497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:17.359497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:17.359497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:17.359497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:17.359497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:17.359497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:17.359497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:17.359497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:17.359497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:17.359497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:17.360379 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:17.360379 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:17.360379 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:17.360379 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:17.360379 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:17.360379 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:17.360379 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:17.360379 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:17.360379 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:17.360379 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:17.360379 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:17.360379 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:17.360379 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:17.360379 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:17.360379 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:17.360379 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:17.361222 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:17.361222 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:17.361222 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:17.361222 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:17.361222 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:17.361222 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:17.361222 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:17.361222 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:17.361222 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:17.361222 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:17.361222 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 03:51:17.361222 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:17.363800 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 208/424] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:51:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 03:51:17.365239 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b0d6e-f717-4a9e-8ed8-a348af746739 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:17.365735 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b0d6e-f717-4a9e-8ed8-a348af746739 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:17.366716 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b0d6e-f717-4a9e-8ed8-a348af746739 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:17.368420 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 209/425] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:17.369350 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b0d6e-f717-4a9e-8ed8-a348af746739 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:17.391282 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d84780-0580-4509-a4dc-b9405176f065 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:17.404334 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:17.432824 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a8b93-e87b-40fb-99f2-656a9cc8b6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:17.433720 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a8b93-e87b-40fb-99f2-656a9cc8b6c0 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:17.434002 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a8b93-e87b-40fb-99f2-656a9cc8b6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:17.434341 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a8b93-e87b-40fb-99f2-656a9cc8b6c0 None admin] PATH_INFO: `/v3/groups/1d29f1905021425b86961966fdbf8308` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:17.436032 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a8b93-e87b-40fb-99f2-656a9cc8b6c0 None admin] RBAC: Authorizing `identity:get_group(group_id=1d29f1905021425b86961966fdbf8308)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:17.437883 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a8b93-e87b-40fb-99f2-656a9cc8b6c0 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:17.445090 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 217/426] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 03:51:17 2022] GET /identity/v3/groups/1d29f1905021425b86961966fdbf8308 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:17.445090 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c49fc8-78c4-41fd-9fab-774b7c9e492d None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:17.445090 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c49fc8-78c4-41fd-9fab-774b7c9e492d None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:17.445090 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c49fc8-78c4-41fd-9fab-774b7c9e492d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:17.466077 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-d3c49fc8-78c4-41fd-9fab-774b7c9e492d None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:17.467656 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-d3c49fc8-78c4-41fd-9fab-774b7c9e492d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:17.489833 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b0d6e-f717-4a9e-8ed8-a348af746739 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:17.529177 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb8a1f-72b7-4ff3-91ba-769b2c25e83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:17.529927 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb8a1f-72b7-4ff3-91ba-769b2c25e83f None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:17.530454 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb8a1f-72b7-4ff3-91ba-769b2c25e83f None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:17.530936 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb8a1f-72b7-4ff3-91ba-769b2c25e83f None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:17.531787 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb8a1f-72b7-4ff3-91ba-769b2c25e83f None admin] RBAC: Adding query filter params (name=member) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:17.532282 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb8a1f-72b7-4ff3-91ba-769b2c25e83f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:17.534121 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb8a1f-72b7-4ff3-91ba-769b2c25e83f None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:17.543680 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 210/427] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 03:51:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:17.544992 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb8a1f-72b7-4ff3-91ba-769b2c25e83f None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:17.557372 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 218/428] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:17.564859 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c49fc8-78c4-41fd-9fab-774b7c9e492d None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:17.591532 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:17.715681 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb8a1f-72b7-4ff3-91ba-769b2c25e83f None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:17.737246 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:17.748112 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c49fc8-78c4-41fd-9fab-774b7c9e492d None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:17.786275 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7397cc-88ed-417e-8685-a9e2e4d3a343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:17.787219 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7397cc-88ed-417e-8685-a9e2e4d3a343 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:17.787746 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7397cc-88ed-417e-8685-a9e2e4d3a343 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:17.788216 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7397cc-88ed-417e-8685-a9e2e4d3a343 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:17.801480 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd751d-54cb-4445-ba65-68b781e82bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:17.804354 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd751d-54cb-4445-ba65-68b781e82bda None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:17.804901 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd751d-54cb-4445-ba65-68b781e82bda None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:17.805392 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd751d-54cb-4445-ba65-68b781e82bda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:17.806320 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd751d-54cb-4445-ba65-68b781e82bda None admin] RBAC: Adding query filter params (group.id=1d29f1905021425b86961966fdbf8308, role.id=eaf433778e9e4d44bf6d1a1ea65d983f, scope.project.id=1cba8bf5387546e18ca3f132b9f78bc1) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:17.807216 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd751d-54cb-4445-ba65-68b781e82bda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:17.809932 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd751d-54cb-4445-ba65-68b781e82bda None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:17.823510 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 211/429] 10.222.0.43 () {56 vars in 1376 bytes} [Fri Aug 19 03:51:17 2022] GET /identity/v3/role_assignments?group.id=1d29f1905021425b86961966fdbf8308&scope.project.id=1cba8bf5387546e18ca3f132b9f78bc1&role.id=eaf433778e9e4d44bf6d1a1ea65d983f => generated 611 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:17.907698 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7397cc-88ed-417e-8685-a9e2e4d3a343 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:17.909305 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7397cc-88ed-417e-8685-a9e2e4d3a343 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:18.013371 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd751d-54cb-4445-ba65-68b781e82bda None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:18.028899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:18.041251 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 219/430] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:51:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:51:18.043840 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7397cc-88ed-417e-8685-a9e2e4d3a343 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:18.151981 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd751d-54cb-4445-ba65-68b781e82bda None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:18.166434 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7397cc-88ed-417e-8685-a9e2e4d3a343 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:18.174791 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:18.208237 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fb3d2-84d1-49f2-9b88-fed9a3312a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:18.209281 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fb3d2-84d1-49f2-9b88-fed9a3312a25 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:18.209765 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fb3d2-84d1-49f2-9b88-fed9a3312a25 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:18.209868 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603fc01-c328-4bff-afa1-dd1835c15ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:18.210364 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fb3d2-84d1-49f2-9b88-fed9a3312a25 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:18.210468 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603fc01-c328-4bff-afa1-dd1835c15ab4 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:18.210685 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603fc01-c328-4bff-afa1-dd1835c15ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:18.210960 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603fc01-c328-4bff-afa1-dd1835c15ab4 None admin] PATH_INFO: `/v3/projects/a17a7b3783004ebe908993932c90f9d9` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:18.212265 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603fc01-c328-4bff-afa1-dd1835c15ab4 None admin] RBAC: Authorizing `identity:get_project(project_id=a17a7b3783004ebe908993932c90f9d9)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:18.213990 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603fc01-c328-4bff-afa1-dd1835c15ab4 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:18.217475 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 220/431] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:51:18 2022] GET /identity/v3/projects/a17a7b3783004ebe908993932c90f9d9 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:18.222865 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603fc01-c328-4bff-afa1-dd1835c15ab4 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:18.229458 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fb3d2-84d1-49f2-9b88-fed9a3312a25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:18.237508 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-c13fb3d2-84d1-49f2-9b88-fed9a3312a25 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 03:51:18.237508 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:18.237508 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:18.237508 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:18.237508 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:18.237508 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:18.237508 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:18.237508 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:18.237508 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:18.237508 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:18.237508 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:18.237508 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:18.237508 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:18.237508 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:18.237508 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:18.237508 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:18.239175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:18.239175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:18.239175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:18.239175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:18.239175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:18.239175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:18.239175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:18.239175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:18.239175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:18.239175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:18.239175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:18.239175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:18.239175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:18.239175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:18.239175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:18.239175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:18.239988 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:18.239988 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:18.239988 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:18.239988 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:18.239988 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:18.239988 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:18.239988 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:18.239988 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:18.239988 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:18.239988 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:18.239988 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 03:51:18.239988 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:18.242448 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 212/432] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 03:51:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 03:51:18.249330 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fb3d2-84d1-49f2-9b88-fed9a3312a25 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:18.311302 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:18.378631 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603fc01-c328-4bff-afa1-dd1835c15ab4 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:18.407354 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fb3d2-84d1-49f2-9b88-fed9a3312a25 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:18.433264 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244eaaf-6668-4ce1-bbf6-111b38390d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:18.434134 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244eaaf-6668-4ce1-bbf6-111b38390d15 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:18.434604 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244eaaf-6668-4ce1-bbf6-111b38390d15 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:18.435287 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244eaaf-6668-4ce1-bbf6-111b38390d15 None admin] PATH_INFO: `/v3/groups/1d29f1905021425b86961966fdbf8308` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:18.436765 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244eaaf-6668-4ce1-bbf6-111b38390d15 None admin] RBAC: Authorizing `identity:get_group(group_id=1d29f1905021425b86961966fdbf8308)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:18.439322 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244eaaf-6668-4ce1-bbf6-111b38390d15 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:18.442011 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 221/433] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 03:51:18 2022] GET /identity/v3/groups/1d29f1905021425b86961966fdbf8308 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:18.447726 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244eaaf-6668-4ce1-bbf6-111b38390d15 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:18.454031 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f11e7-ff83-48b4-bbd0-e7d091802ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:18.454838 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f11e7-ff83-48b4-bbd0-e7d091802ad5 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:18.455254 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f11e7-ff83-48b4-bbd0-e7d091802ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:18.455687 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f11e7-ff83-48b4-bbd0-e7d091802ad5 None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:18.456526 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f11e7-ff83-48b4-bbd0-e7d091802ad5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:18.457020 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f11e7-ff83-48b4-bbd0-e7d091802ad5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:18.458555 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f11e7-ff83-48b4-bbd0-e7d091802ad5 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:18.468300 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 213/434] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:51:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:18.475198 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f11e7-ff83-48b4-bbd0-e7d091802ad5 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:18.497888 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:18.587279 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244eaaf-6668-4ce1-bbf6-111b38390d15 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:18.603805 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f11e7-ff83-48b4-bbd0-e7d091802ad5 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:18.623010 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:18.632541 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea6198-4a6b-4e34-8007-03e414e3cadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:18.632541 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea6198-4a6b-4e34-8007-03e414e3cadd None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:18.632541 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea6198-4a6b-4e34-8007-03e414e3cadd None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:18.632870 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea6198-4a6b-4e34-8007-03e414e3cadd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:18.633480 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea6198-4a6b-4e34-8007-03e414e3cadd None admin] RBAC: Adding query filter params (group.id=1d29f1905021425b86961966fdbf8308, role.id=eaf433778e9e4d44bf6d1a1ea65d983f, scope.project.id=a17a7b3783004ebe908993932c90f9d9) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:18.634289 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea6198-4a6b-4e34-8007-03e414e3cadd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:18.635384 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea6198-4a6b-4e34-8007-03e414e3cadd None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:18.642198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 222/435] 10.222.0.43 () {56 vars in 1376 bytes} [Fri Aug 19 03:51:18 2022] GET /identity/v3/role_assignments?group.id=1d29f1905021425b86961966fdbf8308&scope.project.id=a17a7b3783004ebe908993932c90f9d9&role.id=eaf433778e9e4d44bf6d1a1ea65d983f => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:18.643394 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae75fb-5517-468d-9627-a4aabe845b1a None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:18.643672 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae75fb-5517-468d-9627-a4aabe845b1a None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:18.643943 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae75fb-5517-468d-9627-a4aabe845b1a None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:18.645597 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 223/436] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:18.651174 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac056ec7-3719-4f46-aeeb-18146d5f629e None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:18.651778 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac056ec7-3719-4f46-aeeb-18146d5f629e None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:18.652262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac056ec7-3719-4f46-aeeb-18146d5f629e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:18.657214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe09045-2b53-452b-90f3-eb79166873f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:18.657950 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe09045-2b53-452b-90f3-eb79166873f3 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:18.658233 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe09045-2b53-452b-90f3-eb79166873f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:18.658512 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe09045-2b53-452b-90f3-eb79166873f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:18.673966 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-ac056ec7-3719-4f46-aeeb-18146d5f629e None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:18.676334 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-ac056ec7-3719-4f46-aeeb-18146d5f629e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:18.752673 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 224/437] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 03:51:18.757109 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe09045-2b53-452b-90f3-eb79166873f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:18.758088 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc72df3-ec47-40a0-8de6-2ead6d83720a None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:18.758470 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc72df3-ec47-40a0-8de6-2ead6d83720a None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:18.758848 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc72df3-ec47-40a0-8de6-2ead6d83720a None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:18.759314 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe09045-2b53-452b-90f3-eb79166873f3 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:18.765058 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 225/438] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:18 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:18.767613 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22690491-bd78-456b-aff7-535a51c7e85c None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:18.768003 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22690491-bd78-456b-aff7-535a51c7e85c None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:18.768460 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22690491-bd78-456b-aff7-535a51c7e85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:18.782122 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:18.795012 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-22690491-bd78-456b-aff7-535a51c7e85c None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:18.796760 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-22690491-bd78-456b-aff7-535a51c7e85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:18.883680 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 226/439] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:18.904123 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 214/440] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:51:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:51:18.910594 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22690491-bd78-456b-aff7-535a51c7e85c None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:18.965197 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:19.009647 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22690491-bd78-456b-aff7-535a51c7e85c None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:19.043233 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62478899-0e93-4ce4-af5c-21293cfc56c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:19.043846 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62478899-0e93-4ce4-af5c-21293cfc56c5 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:19.044122 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62478899-0e93-4ce4-af5c-21293cfc56c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:19.044391 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62478899-0e93-4ce4-af5c-21293cfc56c5 None admin] PATH_INFO: `/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:19.045531 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62478899-0e93-4ce4-af5c-21293cfc56c5 None admin] RBAC: Authorizing `identity:get_project(project_id=1cba8bf5387546e18ca3f132b9f78bc1)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:19.046953 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62478899-0e93-4ce4-af5c-21293cfc56c5 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:19.048719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 227/441] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:51:18 2022] GET /identity/v3/projects/1cba8bf5387546e18ca3f132b9f78bc1 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:19.054700 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe09045-2b53-452b-90f3-eb79166873f3 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:19.090141 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62478899-0e93-4ce4-af5c-21293cfc56c5 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:19.158238 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe09045-2b53-452b-90f3-eb79166873f3 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:19.176336 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:19.198956 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a2e5b-de94-438b-98fb-1304b7e19b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:19.199581 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a2e5b-de94-438b-98fb-1304b7e19b68 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:19.199852 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a2e5b-de94-438b-98fb-1304b7e19b68 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:19.200306 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a2e5b-de94-438b-98fb-1304b7e19b68 None admin] PATH_INFO: `/v3/groups/1d29f1905021425b86961966fdbf8308` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:19.201423 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a2e5b-de94-438b-98fb-1304b7e19b68 None admin] RBAC: Authorizing `identity:get_group(group_id=1d29f1905021425b86961966fdbf8308)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:19.202556 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62478899-0e93-4ce4-af5c-21293cfc56c5 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:19.202848 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a2e5b-de94-438b-98fb-1304b7e19b68 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:19.204389 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 215/442] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 03:51:19 2022] GET /identity/v3/groups/1d29f1905021425b86961966fdbf8308 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:19.210853 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a2e5b-de94-438b-98fb-1304b7e19b68 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:19.229297 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:19.241127 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b1c94-805f-4182-9c43-dc95a5efd57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:19.241750 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b1c94-805f-4182-9c43-dc95a5efd57b None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:19.242026 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b1c94-805f-4182-9c43-dc95a5efd57b None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:19.242298 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b1c94-805f-4182-9c43-dc95a5efd57b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:19.252014 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b1c94-805f-4182-9c43-dc95a5efd57b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:19.257267 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-273b1c94-805f-4182-9c43-dc95a5efd57b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 03:51:19.257267 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:19.257267 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:19.257267 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:19.257267 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:19.257267 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:19.257267 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:19.257267 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:19.257267 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:19.257267 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:19.257267 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:19.257267 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:19.257267 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:19.257267 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:19.257267 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:19.257267 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:19.258160 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:19.258160 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:19.258160 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:19.258160 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:19.258160 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:19.258160 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:19.258160 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:19.258160 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:19.258160 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:19.258160 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:19.258160 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:19.258160 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:19.258160 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:19.258160 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:19.258160 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:19.258160 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:19.258992 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:19.258992 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:19.258992 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:19.258992 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:19.258992 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:19.258992 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:19.258992 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:19.258992 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:19.258992 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:19.258992 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:19.258992 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 03:51:19.258992 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:19.258992 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 228/443] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 03:51:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 03:51:19.259715 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b1c94-805f-4182-9c43-dc95a5efd57b None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:19.311433 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a2e5b-de94-438b-98fb-1304b7e19b68 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:19.345298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8221a-5aa5-46eb-9903-c33563790adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:19.345893 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8221a-5aa5-46eb-9903-c33563790adf None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:19.346164 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8221a-5aa5-46eb-9903-c33563790adf None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:19.346432 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8221a-5aa5-46eb-9903-c33563790adf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:19.347141 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8221a-5aa5-46eb-9903-c33563790adf None admin] RBAC: Adding query filter params (group.id=1d29f1905021425b86961966fdbf8308, role.id=99bf21a1487942d3be2b9bdd4483d23e, scope.project.id=1cba8bf5387546e18ca3f132b9f78bc1) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:19.347446 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8221a-5aa5-46eb-9903-c33563790adf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:19.348905 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8221a-5aa5-46eb-9903-c33563790adf None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:19.354439 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 216/444] 10.222.0.43 () {56 vars in 1376 bytes} [Fri Aug 19 03:51:19 2022] GET /identity/v3/role_assignments?group.id=1d29f1905021425b86961966fdbf8308&scope.project.id=1cba8bf5387546e18ca3f132b9f78bc1&role.id=99bf21a1487942d3be2b9bdd4483d23e => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:19.357432 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b1c94-805f-4182-9c43-dc95a5efd57b None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:19.361532 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8221a-5aa5-46eb-9903-c33563790adf None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:19.398663 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309443b-287a-46dc-8a8a-bac21221948d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:19.399297 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309443b-287a-46dc-8a8a-bac21221948d None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:19.399571 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309443b-287a-46dc-8a8a-bac21221948d None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:19.399840 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309443b-287a-46dc-8a8a-bac21221948d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:19.412702 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309443b-287a-46dc-8a8a-bac21221948d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:19.413841 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:19.420101 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-f309443b-287a-46dc-8a8a-bac21221948d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:51:19.420101 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:19.420101 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:19.420101 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:19.420101 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:19.420101 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:19.420101 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:19.420101 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:19.420101 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:19.420101 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:19.420101 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:19.420101 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:19.420101 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:19.420101 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:19.420101 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:19.420101 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:19.421150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:19.421150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:19.421150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:19.421150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:19.421150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:19.421150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:19.421150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:19.421150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:19.421150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:19.421150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:19.421150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:19.421150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:19.421150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:19.421150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:19.421150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:19.421150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:19.421982 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:19.421982 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:19.421982 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:19.421982 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:19.421982 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:19.421982 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:19.421982 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:19.421982 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:19.421982 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:19.421982 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:19.421982 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:51:19.421982 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:19.426336 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 229/445] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 03:51:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:19.427108 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309443b-287a-46dc-8a8a-bac21221948d None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:19.476912 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:19.477788 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8221a-5aa5-46eb-9903-c33563790adf None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:19.516271 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190a82b-e9ae-4ad6-b8c2-18787387c056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:19.516840 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190a82b-e9ae-4ad6-b8c2-18787387c056 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:19.517118 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190a82b-e9ae-4ad6-b8c2-18787387c056 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:19.517398 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190a82b-e9ae-4ad6-b8c2-18787387c056 None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:19.518066 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4190a82b-e9ae-4ad6-b8c2-18787387c056 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:19.518370 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4190a82b-e9ae-4ad6-b8c2-18787387c056 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:19.520089 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4190a82b-e9ae-4ad6-b8c2-18787387c056 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:19.529592 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 217/446] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:51:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:19.535281 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190a82b-e9ae-4ad6-b8c2-18787387c056 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:19.541646 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309443b-287a-46dc-8a8a-bac21221948d None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:19.583965 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb707c6-2bf3-4ec0-a924-e020c8fb0b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:19.584683 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb707c6-2bf3-4ec0-a924-e020c8fb0b46 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:19.584965 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb707c6-2bf3-4ec0-a924-e020c8fb0b46 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:19.585244 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb707c6-2bf3-4ec0-a924-e020c8fb0b46 None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:19.585914 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb707c6-2bf3-4ec0-a924-e020c8fb0b46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:19.586234 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb707c6-2bf3-4ec0-a924-e020c8fb0b46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:19.587606 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb707c6-2bf3-4ec0-a924-e020c8fb0b46 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:19.596297 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 230/447] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:51:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:19.602154 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb707c6-2bf3-4ec0-a924-e020c8fb0b46 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:19.657517 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190a82b-e9ae-4ad6-b8c2-18787387c056 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:19.665105 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:19.703385 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ec2ee-e119-4554-988a-66e16ca72445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:19.704166 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ec2ee-e119-4554-988a-66e16ca72445 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:19.704450 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ec2ee-e119-4554-988a-66e16ca72445 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:19.705117 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ec2ee-e119-4554-988a-66e16ca72445 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:19.725886 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb707c6-2bf3-4ec0-a924-e020c8fb0b46 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:19.730867 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:19.770981 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfac34-b251-46cf-a6c8-2688429556b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:19.771512 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfac34-b251-46cf-a6c8-2688429556b8 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:19.771799 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfac34-b251-46cf-a6c8-2688429556b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:19.772075 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfac34-b251-46cf-a6c8-2688429556b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:19.791756 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ec2ee-e119-4554-988a-66e16ca72445 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:19.793294 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ec2ee-e119-4554-988a-66e16ca72445 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:19.854138 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bfac34-b251-46cf-a6c8-2688429556b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:19.855910 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bfac34-b251-46cf-a6c8-2688429556b8 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:19.912016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 218/448] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:51:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 03:51:19.917344 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ec2ee-e119-4554-988a-66e16ca72445 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:19.924723 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:19.962611 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 231/449] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:51:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 03:51:19.968121 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfac34-b251-46cf-a6c8-2688429556b8 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:19.970745 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:20.016098 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ec2ee-e119-4554-988a-66e16ca72445 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:20.051457 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d490a-4742-49fd-baaa-6776e49b0bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:20.052012 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d490a-4742-49fd-baaa-6776e49b0bc8 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:20.052321 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d490a-4742-49fd-baaa-6776e49b0bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:20.052623 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d490a-4742-49fd-baaa-6776e49b0bc8 None admin] PATH_INFO: `/v3/projects/a17a7b3783004ebe908993932c90f9d9` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:20.053737 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d490a-4742-49fd-baaa-6776e49b0bc8 None admin] RBAC: Authorizing `identity:get_project(project_id=a17a7b3783004ebe908993932c90f9d9)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:20.055177 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d490a-4742-49fd-baaa-6776e49b0bc8 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:20.056818 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 219/450] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:51:19 2022] GET /identity/v3/projects/a17a7b3783004ebe908993932c90f9d9 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:20.062609 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d490a-4742-49fd-baaa-6776e49b0bc8 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:20.071676 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfac34-b251-46cf-a6c8-2688429556b8 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:20.106190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb9b56-ce3a-4eec-a043-0b74adaeaa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:20.106807 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb9b56-ce3a-4eec-a043-0b74adaeaa3c None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:20.107086 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb9b56-ce3a-4eec-a043-0b74adaeaa3c None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:20.107356 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb9b56-ce3a-4eec-a043-0b74adaeaa3c None admin] PATH_INFO: `/v3/projects/55a24eb901d34f7180f97d4cbef6abef` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:20.108471 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb9b56-ce3a-4eec-a043-0b74adaeaa3c None admin] RBAC: Authorizing `identity:get_project(project_id=55a24eb901d34f7180f97d4cbef6abef)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:20.109940 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb9b56-ce3a-4eec-a043-0b74adaeaa3c None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:20.111535 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 232/451] 10.222.0.43 () {56 vars in 1186 bytes} [Fri Aug 19 03:51:19 2022] GET /identity/v3/projects/55a24eb901d34f7180f97d4cbef6abef => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:20.117473 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb9b56-ce3a-4eec-a043-0b74adaeaa3c None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:20.141132 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:20.167041 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d490a-4742-49fd-baaa-6776e49b0bc8 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:20.189024 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:20.201524 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9574c6-263d-45a9-8e7a-30338e3f8939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:20.202154 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9574c6-263d-45a9-8e7a-30338e3f8939 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:20.202435 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9574c6-263d-45a9-8e7a-30338e3f8939 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:20.202708 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9574c6-263d-45a9-8e7a-30338e3f8939 None admin] PATH_INFO: `/v3/groups/1d29f1905021425b86961966fdbf8308` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:20.203833 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9574c6-263d-45a9-8e7a-30338e3f8939 None admin] RBAC: Authorizing `identity:get_group(group_id=1d29f1905021425b86961966fdbf8308)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:20.205312 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9574c6-263d-45a9-8e7a-30338e3f8939 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:20.207117 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 220/452] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 03:51:20 2022] GET /identity/v3/groups/1d29f1905021425b86961966fdbf8308 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:20.212649 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9574c6-263d-45a9-8e7a-30338e3f8939 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:20.217982 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb9b56-ce3a-4eec-a043-0b74adaeaa3c None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:20.251429 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18c0ee-0294-47d8-bf8c-568dc69f1222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:20.252053 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18c0ee-0294-47d8-bf8c-568dc69f1222 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:20.252335 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18c0ee-0294-47d8-bf8c-568dc69f1222 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:20.252639 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18c0ee-0294-47d8-bf8c-568dc69f1222 None admin] PATH_INFO: `/v3/groups/28b098f54ce244518ec86d13cadcd903` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:20.253776 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18c0ee-0294-47d8-bf8c-568dc69f1222 None admin] RBAC: Authorizing `identity:get_group(group_id=28b098f54ce244518ec86d13cadcd903)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:20.255236 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18c0ee-0294-47d8-bf8c-568dc69f1222 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:20.257011 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 233/453] 10.222.0.43 () {56 vars in 1180 bytes} [Fri Aug 19 03:51:20 2022] GET /identity/v3/groups/28b098f54ce244518ec86d13cadcd903 => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:20.262441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18c0ee-0294-47d8-bf8c-568dc69f1222 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:20.311700 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9574c6-263d-45a9-8e7a-30338e3f8939 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:20.345232 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddba18-b0e8-4c81-8a9c-266729cb1f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:20.345827 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddba18-b0e8-4c81-8a9c-266729cb1f04 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:20.346108 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddba18-b0e8-4c81-8a9c-266729cb1f04 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:20.346384 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddba18-b0e8-4c81-8a9c-266729cb1f04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:20.347122 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cddba18-b0e8-4c81-8a9c-266729cb1f04 None admin] RBAC: Adding query filter params (group.id=1d29f1905021425b86961966fdbf8308, role.id=99bf21a1487942d3be2b9bdd4483d23e, scope.project.id=a17a7b3783004ebe908993932c90f9d9) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:20.347965 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cddba18-b0e8-4c81-8a9c-266729cb1f04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:20.349417 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cddba18-b0e8-4c81-8a9c-266729cb1f04 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:20.355160 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 221/454] 10.222.0.43 () {56 vars in 1376 bytes} [Fri Aug 19 03:51:20 2022] GET /identity/v3/role_assignments?group.id=1d29f1905021425b86961966fdbf8308&scope.project.id=a17a7b3783004ebe908993932c90f9d9&role.id=99bf21a1487942d3be2b9bdd4483d23e => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:20.360507 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18c0ee-0294-47d8-bf8c-568dc69f1222 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:20.397132 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afbd9a-5633-44b9-a223-536a7ec66afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:20.397747 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afbd9a-5633-44b9-a223-536a7ec66afb None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:20.398028 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afbd9a-5633-44b9-a223-536a7ec66afb None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:20.398306 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afbd9a-5633-44b9-a223-536a7ec66afb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:20.399037 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4afbd9a-5633-44b9-a223-536a7ec66afb None admin] RBAC: Adding query filter params (group.id=28b098f54ce244518ec86d13cadcd903, role.id=e154509f216e4ae59f74044aa234ddde, scope.project.id=55a24eb901d34f7180f97d4cbef6abef) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:20.399345 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4afbd9a-5633-44b9-a223-536a7ec66afb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:20.400819 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4afbd9a-5633-44b9-a223-536a7ec66afb None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:20.407217 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 234/455] 10.222.0.43 () {56 vars in 1376 bytes} [Fri Aug 19 03:51:20 2022] GET /identity/v3/role_assignments?group.id=28b098f54ce244518ec86d13cadcd903&scope.project.id=55a24eb901d34f7180f97d4cbef6abef&role.id=e154509f216e4ae59f74044aa234ddde => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:22.999704 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2994078-d325-4e39-9f82-70bdd6d89301 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:23.000219 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2994078-d325-4e39-9f82-70bdd6d89301 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:23.000327 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2994078-d325-4e39-9f82-70bdd6d89301 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:23.001901 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 222/456] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:23.007354 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96478574-03cf-4869-81d8-53f783fdf753 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:23.007771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96478574-03cf-4869-81d8-53f783fdf753 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:23.007937 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96478574-03cf-4869-81d8-53f783fdf753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:23.015303 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:23.027695 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-96478574-03cf-4869-81d8-53f783fdf753 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:23.028937 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-96478574-03cf-4869-81d8-53f783fdf753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:23.103592 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 235/457] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:23.114334 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5d330-7535-477c-a118-a4dde9ba8e74 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:23.114960 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5d330-7535-477c-a118-a4dde9ba8e74 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:23.115434 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5d330-7535-477c-a118-a4dde9ba8e74 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:23.118557 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 223/458] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:23.123584 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7efd06-521f-4253-a625-8937e3f02b9f None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:23.124218 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7efd06-521f-4253-a625-8937e3f02b9f None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:23.124727 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7efd06-521f-4253-a625-8937e3f02b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:23.143701 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-9c7efd06-521f-4253-a625-8937e3f02b9f None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:23.145569 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-9c7efd06-521f-4253-a625-8937e3f02b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:23.220596 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 236/459] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:23.291912 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5250e1-0d7a-4105-9f12-95e88370b73b None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:23.292526 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5250e1-0d7a-4105-9f12-95e88370b73b None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:23.292998 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5250e1-0d7a-4105-9f12-95e88370b73b None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:23.294770 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 224/460] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:23.300700 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f957e-78ca-4c07-9321-8a8f337e3802 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:23.301331 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f957e-78ca-4c07-9321-8a8f337e3802 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:23.301803 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f957e-78ca-4c07-9321-8a8f337e3802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:23.320849 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-ba6f957e-78ca-4c07-9321-8a8f337e3802 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:23.322308 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-ba6f957e-78ca-4c07-9321-8a8f337e3802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:23.383430 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:23.392879 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 237/461] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:23.436953 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5250e1-0d7a-4105-9f12-95e88370b73b None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:23.446788 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:23.544890 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f957e-78ca-4c07-9321-8a8f337e3802 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:23.553432 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5250e1-0d7a-4105-9f12-95e88370b73b None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:23.589999 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b621bc6-7b64-4128-9805-b36258875a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:23.590628 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b621bc6-7b64-4128-9805-b36258875a33 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:23.590908 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b621bc6-7b64-4128-9805-b36258875a33 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:23.591184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b621bc6-7b64-4128-9805-b36258875a33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:23.602663 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b621bc6-7b64-4128-9805-b36258875a33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:23.604116 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b621bc6-7b64-4128-9805-b36258875a33 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:23.620135 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-1b621bc6-7b64-4128-9805-b36258875a33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:23.620135 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:23.620135 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:23.620135 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:23.620135 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:23.620135 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:23.620135 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:23.620135 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:23.620135 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:23.620135 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:23.620135 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:23.620135 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:23.620135 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:23.620135 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:23.620135 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:23.620135 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:23.621279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:23.621279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:23.621279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:23.621279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:23.621279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:23.621279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:23.621279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:23.621279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:23.621279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:23.621279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:23.621279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:23.621279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:23.621279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:23.621279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:23.621279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:23.621279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:23.621279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:23.622319 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:23.622319 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:23.622319 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:23.622319 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 225/462] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:23.627231 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b621bc6-7b64-4128-9805-b36258875a33 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:23.670104 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f957e-78ca-4c07-9321-8a8f337e3802 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:23.697162 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:23.706221 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafb470-99b5-4b9b-a871-10b1c313f7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:23.706853 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafb470-99b5-4b9b-a871-10b1c313f7df None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:23.707210 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafb470-99b5-4b9b-a871-10b1c313f7df None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:23.707814 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafb470-99b5-4b9b-a871-10b1c313f7df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:23.717827 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dafb470-99b5-4b9b-a871-10b1c313f7df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:23.719125 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dafb470-99b5-4b9b-a871-10b1c313f7df None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:23.737896 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-6dafb470-99b5-4b9b-a871-10b1c313f7df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:23.737896 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:23.737896 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:23.737896 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:23.737896 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:23.737896 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:23.737896 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:23.737896 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:23.737896 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:23.737896 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:23.737896 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:23.737896 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:23.737896 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:23.737896 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:23.737896 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:23.737896 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:23.738835 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:23.738835 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:23.738835 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:23.738835 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:23.738835 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:23.738835 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:23.738835 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:23.738835 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:23.738835 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:23.738835 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:23.738835 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:23.738835 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:23.738835 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:23.738835 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:23.738835 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:23.738835 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:23.738835 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:23.739706 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:23.739706 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:23.739706 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:23.743690 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 238/463] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 03:51:23.745006 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8c532-fe56-4d75-87e3-225fc58d2d5b None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:23.745287 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8c532-fe56-4d75-87e3-225fc58d2d5b None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:23.745560 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8c532-fe56-4d75-87e3-225fc58d2d5b None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:23.746739 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b621bc6-7b64-4128-9805-b36258875a33 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:23.746834 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 239/464] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:23.747447 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8c532-fe56-4d75-87e3-225fc58d2d5b None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:23.781109 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ef931-646f-45d7-aacf-d5bb6fd4f0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:23.781713 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ef931-646f-45d7-aacf-d5bb6fd4f0c9 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:23.781994 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ef931-646f-45d7-aacf-d5bb6fd4f0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:23.782267 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ef931-646f-45d7-aacf-d5bb6fd4f0c9 None admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:23.782904 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ef931-646f-45d7-aacf-d5bb6fd4f0c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:23.783206 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ef931-646f-45d7-aacf-d5bb6fd4f0c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:23.785126 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ef931-646f-45d7-aacf-d5bb6fd4f0c9 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:23.794404 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:23.797193 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 226/465] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:23.797833 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ef931-646f-45d7-aacf-d5bb6fd4f0c9 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:23.851809 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8c532-fe56-4d75-87e3-225fc58d2d5b None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:23.884368 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf88664-a12c-4acb-8736-715d230e417a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:23.885012 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf88664-a12c-4acb-8736-715d230e417a None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:23.885285 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf88664-a12c-4acb-8736-715d230e417a None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:23.885690 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf88664-a12c-4acb-8736-715d230e417a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:23.894419 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ef931-646f-45d7-aacf-d5bb6fd4f0c9 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:23.895820 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf88664-a12c-4acb-8736-715d230e417a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:23.897303 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf88664-a12c-4acb-8736-715d230e417a None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:23.911490 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-daf88664-a12c-4acb-8736-715d230e417a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:23.911490 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:23.911490 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:23.911490 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:23.911490 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:23.911490 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:23.911490 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:23.911490 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:23.911490 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:23.911490 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:23.911490 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:23.911490 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:23.911490 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:23.911490 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:23.911490 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:23.911490 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:23.912441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:23.912441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:23.912441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:23.912441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:23.912441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:23.912441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:23.912441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:23.912441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:23.912441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:23.912441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:23.912441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:23.912441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:23.912441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:23.912441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:23.912441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:23.912441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:23.912441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:23.913371 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:23.913371 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:23.913371 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:23.913371 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 240/466] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:23.913750 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0133d-fbe4-4c63-9aec-2e0d80ae3e15 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:23.913973 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0133d-fbe4-4c63-9aec-2e0d80ae3e15 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:23.914221 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0133d-fbe4-4c63-9aec-2e0d80ae3e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:23.918034 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:23.932064 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-e3e0133d-fbe4-4c63-9aec-2e0d80ae3e15 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:23.933272 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-e3e0133d-fbe4-4c63-9aec-2e0d80ae3e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:23.935901 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf90cf-7a4b-409c-bdc7-16d4d42c3c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:23.936788 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf90cf-7a4b-409c-bdc7-16d4d42c3c81 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:23.937228 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf90cf-7a4b-409c-bdc7-16d4d42c3c81 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:23.937709 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf90cf-7a4b-409c-bdc7-16d4d42c3c81 None admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:23.938858 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf90cf-7a4b-409c-bdc7-16d4d42c3c81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:23.939373 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf90cf-7a4b-409c-bdc7-16d4d42c3c81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:23.941926 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf90cf-7a4b-409c-bdc7-16d4d42c3c81 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:23.953717 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 227/467] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:23.954649 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf90cf-7a4b-409c-bdc7-16d4d42c3c81 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:23.999926 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 241/468] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:24.000726 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0133d-fbe4-4c63-9aec-2e0d80ae3e15 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:24.027956 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:24.058693 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf90cf-7a4b-409c-bdc7-16d4d42c3c81 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:24.095773 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df253dc1-e9c7-484e-8f42-b2df75970ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:24.096961 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df253dc1-e9c7-484e-8f42-b2df75970ea2 None admin] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:24.097243 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df253dc1-e9c7-484e-8f42-b2df75970ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:24.097512 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df253dc1-e9c7-484e-8f42-b2df75970ea2 None admin] PATH_INFO: `/v3/users` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:24.098138 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df253dc1-e9c7-484e-8f42-b2df75970ea2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:24.099576 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df253dc1-e9c7-484e-8f42-b2df75970ea2 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:24.107469 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0133d-fbe4-4c63-9aec-2e0d80ae3e15 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:24.121520 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 228/469] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 03:51:23 2022] POST /identity/v3/users => generated 246 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:51:24.121520 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df253dc1-e9c7-484e-8f42-b2df75970ea2 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:24.156803 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198aee57-8991-4825-9738-333bd37d9fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:24.157499 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198aee57-8991-4825-9738-333bd37d9fd2 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:24.157783 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198aee57-8991-4825-9738-333bd37d9fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:24.158059 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198aee57-8991-4825-9738-333bd37d9fd2 None admin] PATH_INFO: `/v3/domains` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:24.158715 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198aee57-8991-4825-9738-333bd37d9fd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:24.159083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198aee57-8991-4825-9738-333bd37d9fd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:24.160706 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198aee57-8991-4825-9738-333bd37d9fd2 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:24.182740 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 242/470] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:24.187986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198aee57-8991-4825-9738-333bd37d9fd2 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:24.196996 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:24.295519 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:24.302502 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df253dc1-e9c7-484e-8f42-b2df75970ea2 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:24.312367 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198aee57-8991-4825-9738-333bd37d9fd2 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:24.351226 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df4f71-99d3-4b48-adce-6a5a7c19da79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:24.351830 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df4f71-99d3-4b48-adce-6a5a7c19da79 None admin] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:24.352110 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df4f71-99d3-4b48-adce-6a5a7c19da79 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:24.352379 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df4f71-99d3-4b48-adce-6a5a7c19da79 None admin] PATH_INFO: `/v3/users` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:24.353048 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df4f71-99d3-4b48-adce-6a5a7c19da79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:24.354091 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46f113-9075-4b93-9f12-4cb6ca1924c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:24.354488 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df4f71-99d3-4b48-adce-6a5a7c19da79 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:24.354700 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46f113-9075-4b93-9f12-4cb6ca1924c2 None admin] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:24.354982 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46f113-9075-4b93-9f12-4cb6ca1924c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:24.355256 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46f113-9075-4b93-9f12-4cb6ca1924c2 None admin] PATH_INFO: `/v3/users` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:24.355900 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46f113-9075-4b93-9f12-4cb6ca1924c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:24.357382 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46f113-9075-4b93-9f12-4cb6ca1924c2 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:24.381757 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 229/471] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 03:51:24 2022] POST /identity/v3/users => generated 248 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:51:24.382661 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df4f71-99d3-4b48-adce-6a5a7c19da79 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:24.383766 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 243/472] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 03:51:24 2022] POST /identity/v3/users => generated 248 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:51:24.507858 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:24.519930 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df4f71-99d3-4b48-adce-6a5a7c19da79 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:24.564663 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ee072-3e55-46d5-a857-74c1f17a7502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:24.565359 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ee072-3e55-46d5-a857-74c1f17a7502 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:24.565641 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ee072-3e55-46d5-a857-74c1f17a7502 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:24.565913 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ee072-3e55-46d5-a857-74c1f17a7502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:24.579392 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ee072-3e55-46d5-a857-74c1f17a7502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:24.580124 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ee072-3e55-46d5-a857-74c1f17a7502 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:24.595710 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-390ee072-3e55-46d5-a857-74c1f17a7502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:24.595710 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:24.595710 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:24.595710 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:24.595710 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:24.595710 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:24.595710 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:24.595710 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:24.595710 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:24.595710 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:24.595710 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:24.595710 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:24.595710 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:24.595710 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:24.595710 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:24.595710 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:24.597300 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:24.597300 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:24.597300 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:24.597300 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:24.597300 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:24.597300 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:24.597300 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:24.597300 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:24.597300 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:24.597300 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:24.597300 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:24.597300 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:24.597300 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:24.597300 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:24.597300 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:24.597300 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:24.597300 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:24.598172 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:24.598172 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:24.598172 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:24.598172 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 230/473] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:24.603627 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46f113-9075-4b93-9f12-4cb6ca1924c2 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:24.723180 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46f113-9075-4b93-9f12-4cb6ca1924c2 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:24.760639 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b183756-3386-44e4-b9ab-841eab931f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:24.761254 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b183756-3386-44e4-b9ab-841eab931f02 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:24.761531 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b183756-3386-44e4-b9ab-841eab931f02 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:24.761807 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b183756-3386-44e4-b9ab-841eab931f02 None admin] PATH_INFO: `/v3/domains` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:24.762446 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b183756-3386-44e4-b9ab-841eab931f02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:24.762748 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b183756-3386-44e4-b9ab-841eab931f02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:24.764246 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b183756-3386-44e4-b9ab-841eab931f02 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:24.777797 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 244/474] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:24.782921 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ee072-3e55-46d5-a857-74c1f17a7502 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:24.888597 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ee072-3e55-46d5-a857-74c1f17a7502 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:24.924315 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91e05e-1261-453a-b2bd-eb5eeba9868c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:24.925055 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91e05e-1261-453a-b2bd-eb5eeba9868c None admin] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:24.925337 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91e05e-1261-453a-b2bd-eb5eeba9868c None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:24.925609 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91e05e-1261-453a-b2bd-eb5eeba9868c None admin] PATH_INFO: `/v3/users` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:24.926248 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91e05e-1261-453a-b2bd-eb5eeba9868c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:24.927750 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91e05e-1261-453a-b2bd-eb5eeba9868c None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:24.945703 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:24.952300 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 231/475] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 03:51:24 2022] POST /identity/v3/users => generated 249 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 03:51:26.464247 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d353b-b690-4db1-8595-88f1d5b0ab4b None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:26.464752 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d353b-b690-4db1-8595-88f1d5b0ab4b None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:26.464752 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d353b-b690-4db1-8595-88f1d5b0ab4b None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:26.466344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 245/476] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:26.472144 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad53f1-8129-429e-9ffa-051bbab78e93 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:26.473006 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad53f1-8129-429e-9ffa-051bbab78e93 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:26.473491 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad53f1-8129-429e-9ffa-051bbab78e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:26.491950 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-9fad53f1-8129-429e-9ffa-051bbab78e93 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:26.493476 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-9fad53f1-8129-429e-9ffa-051bbab78e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:26.576203 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 232/477] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:26.700462 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3d50e-50bc-4d5a-9905-d5c8be64ccd1 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:26.700817 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3d50e-50bc-4d5a-9905-d5c8be64ccd1 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:26.701050 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3d50e-50bc-4d5a-9905-d5c8be64ccd1 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:26.702649 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 246/478] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:26.708493 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b89b1-ae1b-42f0-b1ad-ce057f125e66 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:26.708791 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b89b1-ae1b-42f0-b1ad-ce057f125e66 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:26.709068 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b89b1-ae1b-42f0-b1ad-ce057f125e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:26.727692 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-c09b89b1-ae1b-42f0-b1ad-ce057f125e66 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:26.728851 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-c09b89b1-ae1b-42f0-b1ad-ce057f125e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:26.746402 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b85c2-a873-4047-a343-8ed1170dc5d8 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:26.746720 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b85c2-a873-4047-a343-8ed1170dc5d8 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:26.746962 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b85c2-a873-4047-a343-8ed1170dc5d8 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:26.748557 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 247/479] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:26.753958 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fe6e7-2382-4230-9c48-9daffe6ea75c None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:26.754242 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fe6e7-2382-4230-9c48-9daffe6ea75c None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:26.754521 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fe6e7-2382-4230-9c48-9daffe6ea75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:26.762623 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:26.777286 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-509fe6e7-2382-4230-9c48-9daffe6ea75c None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:26.778655 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-509fe6e7-2382-4230-9c48-9daffe6ea75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:26.815301 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 233/480] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:26.855453 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 248/481] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:26.911266 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b89b1-ae1b-42f0-b1ad-ce057f125e66 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:26.973101 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:27.018717 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b89b1-ae1b-42f0-b1ad-ce057f125e66 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:27.057929 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346999fe-d297-428b-a228-f841889be0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:27.058581 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346999fe-d297-428b-a228-f841889be0d6 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:27.058856 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346999fe-d297-428b-a228-f841889be0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:27.059132 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346999fe-d297-428b-a228-f841889be0d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:27.071171 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346999fe-d297-428b-a228-f841889be0d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:27.075978 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-346999fe-d297-428b-a228-f841889be0d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:51:27.075978 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:27.075978 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:27.075978 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:27.075978 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:27.075978 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:27.075978 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:27.075978 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:27.075978 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:27.075978 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:27.075978 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:27.075978 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:27.075978 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:27.075978 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:27.075978 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:27.075978 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:27.078421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:27.078421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:27.078421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:27.078421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:27.078421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:27.078421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:27.078421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:27.078421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:27.078421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:27.078421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:27.078421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:27.078421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:27.078421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:27.078421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:27.078421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:27.078421 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:27.080369 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:27.080369 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:27.080369 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:27.080369 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:27.080369 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:27.080369 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:27.080369 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:27.080369 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:27.080369 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:27.080369 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:27.080369 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:51:27.080369 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:27.080369 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 234/482] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 03:51:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:27.084915 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fe6e7-2382-4230-9c48-9daffe6ea75c None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:27.154730 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346999fe-d297-428b-a228-f841889be0d6 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:27.197595 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fe6e7-2382-4230-9c48-9daffe6ea75c None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:27.234452 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19c175-695f-4239-bda7-4d25a815cffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:27.235086 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19c175-695f-4239-bda7-4d25a815cffc None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:27.235371 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19c175-695f-4239-bda7-4d25a815cffc None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:27.235643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19c175-695f-4239-bda7-4d25a815cffc None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:27.236854 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19c175-695f-4239-bda7-4d25a815cffc None admin] RBAC: Adding query filter params (name=service) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:27.237161 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19c175-695f-4239-bda7-4d25a815cffc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:27.238537 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19c175-695f-4239-bda7-4d25a815cffc None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:27.239861 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:27.248241 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 249/483] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 03:51:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:27.249469 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c806f0-aacb-4eba-8750-9a402d8e82a7 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:27.249756 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c806f0-aacb-4eba-8750-9a402d8e82a7 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:27.250031 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c806f0-aacb-4eba-8750-9a402d8e82a7 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:27.251377 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 250/484] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:27.252522 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c806f0-aacb-4eba-8750-9a402d8e82a7 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:27.278443 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346999fe-d297-428b-a228-f841889be0d6 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:27.295417 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:27.313354 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523d3f1-d6d1-4ee8-b52a-2da533b648b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:27.313974 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523d3f1-d6d1-4ee8-b52a-2da533b648b0 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:27.314246 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523d3f1-d6d1-4ee8-b52a-2da533b648b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:27.315087 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523d3f1-d6d1-4ee8-b52a-2da533b648b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:27.325063 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523d3f1-d6d1-4ee8-b52a-2da533b648b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:27.330298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-c523d3f1-d6d1-4ee8-b52a-2da533b648b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:51:27.330298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:27.330298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:27.330298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:27.330298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:27.330298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:27.330298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:27.330298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:27.330298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:27.330298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:27.330298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:27.330298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:27.330298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:27.330298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:27.330298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:27.330298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:27.331279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:27.331279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:27.331279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:27.331279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:27.331279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:27.331279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:27.331279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:27.331279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:27.331279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:27.331279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:27.331279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:27.331279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:27.331279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:27.331279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:27.331279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:27.331279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:27.332090 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:27.332090 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:27.332090 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:27.332090 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:27.332090 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:27.332090 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:27.332090 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:27.332090 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:27.332090 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:27.332090 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:27.332090 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:51:27.332090 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:27.332090 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 235/485] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 03:51:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 03:51:27.332845 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523d3f1-d6d1-4ee8-b52a-2da533b648b0 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:27.355426 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c806f0-aacb-4eba-8750-9a402d8e82a7 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:27.388224 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23465fe3-f49a-430f-8d15-f97b155d8fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:27.388869 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23465fe3-f49a-430f-8d15-f97b155d8fb5 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:27.389151 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23465fe3-f49a-430f-8d15-f97b155d8fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:27.389422 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23465fe3-f49a-430f-8d15-f97b155d8fb5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:27.399746 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23465fe3-f49a-430f-8d15-f97b155d8fb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:27.404385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-23465fe3-f49a-430f-8d15-f97b155d8fb5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:51:27.404385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:27.404385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:27.404385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:27.404385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:27.404385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:27.404385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:27.404385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:27.404385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:27.404385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:27.404385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:27.404385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:27.404385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:27.404385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:27.404385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:27.404385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:27.405443 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:27.405443 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:27.405443 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:27.405443 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:27.405443 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:27.405443 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:27.405443 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:27.405443 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:27.405443 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:27.405443 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:27.405443 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:27.405443 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:27.405443 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:27.405443 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:27.405443 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:27.405443 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:27.406268 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:27.406268 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:27.406268 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:27.406268 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:27.406268 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:27.406268 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:27.406268 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:27.406268 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:27.406268 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:27.406268 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:27.406268 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:51:27.406268 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:27.406268 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 251/486] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 03:51:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:27.406947 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36530b64-1a61-4c52-9695-505db8051ac0 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:27.407482 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36530b64-1a61-4c52-9695-505db8051ac0 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:27.407482 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36530b64-1a61-4c52-9695-505db8051ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:27.425218 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-36530b64-1a61-4c52-9695-505db8051ac0 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:27.426384 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-36530b64-1a61-4c52-9695-505db8051ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:27.433192 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523d3f1-d6d1-4ee8-b52a-2da533b648b0 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:27.466025 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b8245-a8a2-490e-9d76-e902ad3c707b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:27.466675 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b8245-a8a2-490e-9d76-e902ad3c707b None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:27.466979 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b8245-a8a2-490e-9d76-e902ad3c707b None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:27.467255 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b8245-a8a2-490e-9d76-e902ad3c707b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:27.473990 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:27.478686 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b8245-a8a2-490e-9d76-e902ad3c707b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:27.480164 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b8245-a8a2-490e-9d76-e902ad3c707b None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:27.491291 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 252/487] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:27.492074 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36530b64-1a61-4c52-9695-505db8051ac0 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:27.494289 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-779b8245-a8a2-490e-9d76-e902ad3c707b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:27.494289 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:27.494289 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:27.494289 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:27.494289 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:27.494289 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:27.494289 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:27.494289 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:27.494289 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:27.494289 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:27.494289 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:27.494289 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:27.494289 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:27.494289 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:27.494289 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:27.494289 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:27.495168 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:27.495168 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:27.495168 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:27.495168 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:27.495168 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:27.495168 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:27.495168 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:27.495168 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:27.495168 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:27.495168 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:27.495168 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:27.495168 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:27.495168 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:27.495168 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:27.495168 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:27.495168 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:27.495168 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:27.496055 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:27.496055 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:27.496055 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:27.496055 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 236/488] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:27.496270 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b8245-a8a2-490e-9d76-e902ad3c707b None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:27.529078 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:27.599824 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36530b64-1a61-4c52-9695-505db8051ac0 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:27.604922 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b8245-a8a2-490e-9d76-e902ad3c707b None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:27.636435 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a210ccc-4e0d-478c-be13-544d643e886e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:27.637318 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a210ccc-4e0d-478c-be13-544d643e886e None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:27.637802 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a210ccc-4e0d-478c-be13-544d643e886e None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:27.638169 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55361e3-22bf-416c-9609-3e943fc9f95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:27.638453 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a210ccc-4e0d-478c-be13-544d643e886e None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:27.638767 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55361e3-22bf-416c-9609-3e943fc9f95a None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:27.639044 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55361e3-22bf-416c-9609-3e943fc9f95a None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:27.639317 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55361e3-22bf-416c-9609-3e943fc9f95a None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:27.639820 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a210ccc-4e0d-478c-be13-544d643e886e None admin] RBAC: Adding query filter params (name=service) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:27.639964 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55361e3-22bf-416c-9609-3e943fc9f95a None admin] RBAC: Adding query filter params (name=service) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:27.640252 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55361e3-22bf-416c-9609-3e943fc9f95a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:27.640706 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a210ccc-4e0d-478c-be13-544d643e886e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:27.641657 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55361e3-22bf-416c-9609-3e943fc9f95a None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:27.642149 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a210ccc-4e0d-478c-be13-544d643e886e None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:27.654684 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 237/489] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 03:51:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:27.654842 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 253/490] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 03:51:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:27.654933 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55361e3-22bf-416c-9609-3e943fc9f95a None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:27.656930 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a210ccc-4e0d-478c-be13-544d643e886e None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:27.704838 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:27.751480 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:27.755377 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a210ccc-4e0d-478c-be13-544d643e886e None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:27.761297 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55361e3-22bf-416c-9609-3e943fc9f95a None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:27.792826 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ef71e-484c-470d-8d24-16eece406c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:27.793382 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ef71e-484c-470d-8d24-16eece406c41 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:27.793785 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ef71e-484c-470d-8d24-16eece406c41 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:27.794077 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ef71e-484c-470d-8d24-16eece406c41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:27.796981 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00006a1d-47de-4f8a-a9f3-3a4584930f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:27.797583 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00006a1d-47de-4f8a-a9f3-3a4584930f1c None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:27.797857 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00006a1d-47de-4f8a-a9f3-3a4584930f1c None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:27.798132 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00006a1d-47de-4f8a-a9f3-3a4584930f1c None admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:27.798767 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00006a1d-47de-4f8a-a9f3-3a4584930f1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:27.799067 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00006a1d-47de-4f8a-a9f3-3a4584930f1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:27.800448 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00006a1d-47de-4f8a-a9f3-3a4584930f1c None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:27.807419 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ef71e-484c-470d-8d24-16eece406c41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:27.809342 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ef71e-484c-470d-8d24-16eece406c41 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:27.813828 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 238/491] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:27.814836 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00006a1d-47de-4f8a-a9f3-3a4584930f1c None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:27.826676 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-a37ef71e-484c-470d-8d24-16eece406c41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:27.826676 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:27.826676 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:27.826676 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:27.826676 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:27.826676 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:27.826676 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:27.826676 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:27.826676 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:27.826676 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:27.826676 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:27.826676 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:27.826676 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:27.826676 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:27.826676 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:27.826676 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:27.827666 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:27.827666 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:27.827666 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:27.827666 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:27.827666 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:27.827666 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:27.827666 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:27.827666 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:27.827666 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:27.827666 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:27.827666 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:27.827666 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:27.827666 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:27.827666 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:27.827666 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:27.827666 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:27.827666 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:27.828919 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:27.828919 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:27.828919 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:27.828919 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 254/492] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:27.828919 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ef71e-484c-470d-8d24-16eece406c41 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:27.915943 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00006a1d-47de-4f8a-a9f3-3a4584930f1c None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:27.922656 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:27.926322 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ef71e-484c-470d-8d24-16eece406c41 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:27.948931 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba9540-c525-4ef2-bc5d-77a36c6ec190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:27.949658 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba9540-c525-4ef2-bc5d-77a36c6ec190 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:27.950006 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba9540-c525-4ef2-bc5d-77a36c6ec190 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:27.950287 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba9540-c525-4ef2-bc5d-77a36c6ec190 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:27.959470 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8c733-4c6e-46bd-bac8-47a721f7bb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:27.960088 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8c733-4c6e-46bd-bac8-47a721f7bb39 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:27.960366 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8c733-4c6e-46bd-bac8-47a721f7bb39 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:27.960681 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8c733-4c6e-46bd-bac8-47a721f7bb39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:27.960785 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba9540-c525-4ef2-bc5d-77a36c6ec190 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:27.962155 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba9540-c525-4ef2-bc5d-77a36c6ec190 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:27.971830 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8c733-4c6e-46bd-bac8-47a721f7bb39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:27.976927 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-cfa8c733-4c6e-46bd-bac8-47a721f7bb39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:51:27.976927 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:27.976927 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:27.976927 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:27.976927 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:27.976927 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:27.976927 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:27.976927 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:27.976927 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:27.976927 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:27.976927 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:27.976927 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:27.976927 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:27.976927 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:27.976927 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:27.976927 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:27.978048 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:27.978048 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:27.978048 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:27.978048 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:27.978048 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:27.978048 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:27.978048 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:27.978048 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:27.978048 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:27.978048 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:27.978048 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:27.978048 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:27.978048 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:27.978048 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:27.978048 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:27.978048 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:27.979358 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:27.979358 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:27.979358 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:27.979358 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:27.979358 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:27.979358 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:27.979358 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:27.979358 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:27.979358 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:27.979358 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:27.979358 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:51:27.979358 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:27.979979 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-28ba9540-c525-4ef2-bc5d-77a36c6ec190 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:27.979979 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:27.979979 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:27.979979 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:27.979979 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:27.979979 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:27.979979 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:27.979979 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:27.979979 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:27.979979 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:27.979979 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:27.979979 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:27.979979 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:27.979979 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:27.979979 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:27.979979 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:27.980810 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:27.980810 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:27.980810 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:27.980810 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:27.980810 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:27.980810 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:27.980810 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:27.980810 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:27.980810 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:27.980810 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:27.980810 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:27.980810 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:27.980810 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:27.980810 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:27.980810 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:27.980810 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:27.980810 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:27.983382 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:27.983382 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:27.983382 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:27.983637 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 255/493] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 03:51:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:27.983637 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8c733-4c6e-46bd-bac8-47a721f7bb39 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:27.983791 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 239/494] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:27.983791 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba9540-c525-4ef2-bc5d-77a36c6ec190 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:27.987574 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:28.078280 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8c733-4c6e-46bd-bac8-47a721f7bb39 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:28.083524 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba9540-c525-4ef2-bc5d-77a36c6ec190 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:28.111657 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b67ed-7129-46a0-bdc1-8a2e256f5c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:28.112275 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b67ed-7129-46a0-bdc1-8a2e256f5c86 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:28.112593 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b67ed-7129-46a0-bdc1-8a2e256f5c86 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:28.112898 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b67ed-7129-46a0-bdc1-8a2e256f5c86 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:28.117442 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10446c90-8d33-4c4e-9a1a-716207cd4f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:28.118102 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10446c90-8d33-4c4e-9a1a-716207cd4f05 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:28.118443 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10446c90-8d33-4c4e-9a1a-716207cd4f05 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:28.118779 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10446c90-8d33-4c4e-9a1a-716207cd4f05 None admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:28.119473 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10446c90-8d33-4c4e-9a1a-716207cd4f05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:28.119777 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10446c90-8d33-4c4e-9a1a-716207cd4f05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:28.120167 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b67ed-7129-46a0-bdc1-8a2e256f5c86 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:28.121174 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10446c90-8d33-4c4e-9a1a-716207cd4f05 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:28.121631 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b67ed-7129-46a0-bdc1-8a2e256f5c86 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:28.132926 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 240/495] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:28.133702 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10446c90-8d33-4c4e-9a1a-716207cd4f05 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:28.134362 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-a00b67ed-7129-46a0-bdc1-8a2e256f5c86 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 03:51:28.134362 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:28.134362 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:28.134362 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:28.134362 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:28.134362 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:28.134362 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:28.134362 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:28.134362 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:28.134362 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:28.134362 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:28.134362 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:28.134362 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 03:51:28.134362 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 03:51:28.134362 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 03:51:28.134362 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 03:51:28.135233 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:28.135233 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:28.135233 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 03:51:28.135233 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:28.135233 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 03:51:28.135233 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:28.135233 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:28.135233 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:28.135233 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:28.135233 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:28.135233 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:28.135233 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:28.135233 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:28.135233 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:28.135233 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:28.135233 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:28.135233 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:28.135233 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:28.136173 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:28.136173 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:28.136173 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 03:51:28.136173 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 03:51:28.136173 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 03:51:28.136173 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 03:51:28.136173 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 03:51:28.136173 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 03:51:28.136173 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 03:51:28.136173 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:28.136173 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 256/496] 10.222.0.43 () {56 vars in 1093 bytes} [Fri Aug 19 03:51:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:28.136784 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b67ed-7129-46a0-bdc1-8a2e256f5c86 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:28.162586 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:28.207381 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:28.241114 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b67ed-7129-46a0-bdc1-8a2e256f5c86 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:28.243671 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10446c90-8d33-4c4e-9a1a-716207cd4f05 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:28.274628 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a79b18-6f2c-4894-93f9-3ae0b046df4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:28.275215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a79b18-6f2c-4894-93f9-3ae0b046df4b None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:28.275494 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a79b18-6f2c-4894-93f9-3ae0b046df4b None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:28.275769 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a79b18-6f2c-4894-93f9-3ae0b046df4b None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:28.276412 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a79b18-6f2c-4894-93f9-3ae0b046df4b None admin] RBAC: Adding query filter params (name=service) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:28.276743 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a79b18-6f2c-4894-93f9-3ae0b046df4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:28.278177 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a79b18-6f2c-4894-93f9-3ae0b046df4b None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:28.278657 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc5ee4-3acc-4060-8f9d-b0e0013f1870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:28.279259 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc5ee4-3acc-4060-8f9d-b0e0013f1870 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:28.279537 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc5ee4-3acc-4060-8f9d-b0e0013f1870 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:28.279809 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc5ee4-3acc-4060-8f9d-b0e0013f1870 None admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:28.280433 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc5ee4-3acc-4060-8f9d-b0e0013f1870 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:28.280763 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc5ee4-3acc-4060-8f9d-b0e0013f1870 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:28.282115 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc5ee4-3acc-4060-8f9d-b0e0013f1870 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:28.285894 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 257/497] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 03:51:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:28.286667 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a79b18-6f2c-4894-93f9-3ae0b046df4b None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:28.296751 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 241/498] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:28.296751 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc5ee4-3acc-4060-8f9d-b0e0013f1870 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:28.366709 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:28.385892 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a79b18-6f2c-4894-93f9-3ae0b046df4b None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:28.395009 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc5ee4-3acc-4060-8f9d-b0e0013f1870 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:28.417375 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:28.418584 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63981ed9-a2f8-496f-958e-e77cd540854f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:28.419367 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63981ed9-a2f8-496f-958e-e77cd540854f None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:28.419656 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63981ed9-a2f8-496f-958e-e77cd540854f None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:28.419925 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63981ed9-a2f8-496f-958e-e77cd540854f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:28.427350 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63981ed9-a2f8-496f-958e-e77cd540854f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:28.428815 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63981ed9-a2f8-496f-958e-e77cd540854f None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:28.428977 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851a4b9-18b3-412c-b440-06dc9b62c23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:28.429576 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851a4b9-18b3-412c-b440-06dc9b62c23e None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:28.429857 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851a4b9-18b3-412c-b440-06dc9b62c23e None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:28.430134 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851a4b9-18b3-412c-b440-06dc9b62c23e None admin] PATH_INFO: `/v3/users` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:28.430850 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851a4b9-18b3-412c-b440-06dc9b62c23e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:28.431158 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851a4b9-18b3-412c-b440-06dc9b62c23e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:28.432615 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851a4b9-18b3-412c-b440-06dc9b62c23e None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:28.440067 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-63981ed9-a2f8-496f-958e-e77cd540854f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 03:51:28.440067 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:28.440067 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:28.440067 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:28.440067 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:28.440067 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:28.440067 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:28.440067 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:28.440067 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:28.440067 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:28.440067 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:28.440067 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:28.440067 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 03:51:28.440067 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 03:51:28.440067 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 03:51:28.440067 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 03:51:28.440986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:28.440986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:28.440986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 03:51:28.440986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:28.440986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 03:51:28.440986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:28.440986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:28.440986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:28.440986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:28.440986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:28.440986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:28.440986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:28.440986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:28.440986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:28.440986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:28.440986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:28.440986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:28.440986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:28.441897 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:28.441897 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:28.441897 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 03:51:28.441897 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 03:51:28.441897 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 03:51:28.441897 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 03:51:28.441897 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 03:51:28.441897 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 03:51:28.441897 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 03:51:28.441897 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:28.441897 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 258/499] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:51:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:28.441897 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63981ed9-a2f8-496f-958e-e77cd540854f None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:28.471538 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 242/500] 10.222.0.43 () {56 vars in 1133 bytes} [Fri Aug 19 03:51:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:28.472369 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851a4b9-18b3-412c-b440-06dc9b62c23e None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:28.551114 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63981ed9-a2f8-496f-958e-e77cd540854f None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:28.572799 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851a4b9-18b3-412c-b440-06dc9b62c23e None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:28.584311 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c23e3b-96a7-4167-9794-18a8389c0d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:28.584983 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c23e3b-96a7-4167-9794-18a8389c0d88 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:28.585263 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c23e3b-96a7-4167-9794-18a8389c0d88 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:28.585544 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c23e3b-96a7-4167-9794-18a8389c0d88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:28.595724 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c23e3b-96a7-4167-9794-18a8389c0d88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:28.597211 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c23e3b-96a7-4167-9794-18a8389c0d88 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:28.598966 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:28.606204 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c6149-0a04-43a3-aebb-c58050df8c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:28.606821 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c6149-0a04-43a3-aebb-c58050df8c1b None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:28.607096 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c6149-0a04-43a3-aebb-c58050df8c1b None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:28.607362 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c6149-0a04-43a3-aebb-c58050df8c1b None admin] PATH_INFO: `/v3/users/glance` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:28.612730 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-28c23e3b-96a7-4167-9794-18a8389c0d88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:28.612730 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:28.612730 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:28.612730 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:28.612730 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:28.612730 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:28.612730 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:28.612730 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:28.612730 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:28.612730 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:28.612730 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:28.612730 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:28.612730 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:28.612730 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:28.612730 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:28.612730 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:28.613631 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:28.613631 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:28.613631 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:28.613631 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:28.613631 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:28.613631 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:28.613631 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:28.613631 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:28.613631 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:28.613631 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:28.613631 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:28.613631 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:28.613631 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:28.613631 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:28.613631 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:28.613631 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:28.613631 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:28.614528 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:28.614528 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:28.614528 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:28.614528 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 259/501] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:28.614743 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c23e3b-96a7-4167-9794-18a8389c0d88 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:28.616139 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c6149-0a04-43a3-aebb-c58050df8c1b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:28.617666 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c6149-0a04-43a3-aebb-c58050df8c1b None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:28.631165 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-e04c6149-0a04-43a3-aebb-c58050df8c1b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 03:51:28.631165 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:28.631165 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:28.631165 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:28.631165 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:28.631165 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:28.631165 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:28.631165 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:28.631165 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:28.631165 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:28.631165 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:28.631165 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:28.631165 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 03:51:28.631165 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 03:51:28.631165 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 03:51:28.631165 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 03:51:28.632214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:28.632214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:28.632214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 03:51:28.632214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:28.632214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 03:51:28.632214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:28.632214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:28.632214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:28.632214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:28.632214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:28.632214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:28.632214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:28.632214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:28.632214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:28.632214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:28.632214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:28.632214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:28.632214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:28.633170 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:28.633170 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:28.633170 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 03:51:28.633170 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 03:51:28.633170 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 03:51:28.633170 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 03:51:28.633170 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 03:51:28.633170 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 03:51:28.633170 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 03:51:28.633170 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:28.633170 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 243/502] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:51:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:28.633170 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c6149-0a04-43a3-aebb-c58050df8c1b None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:28.676091 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:28.719776 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c23e3b-96a7-4167-9794-18a8389c0d88 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:28.732074 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c6149-0a04-43a3-aebb-c58050df8c1b None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:28.752751 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b5deb-7ade-4354-a9a7-b8d01acad709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:28.753340 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b5deb-7ade-4354-a9a7-b8d01acad709 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:28.753615 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b5deb-7ade-4354-a9a7-b8d01acad709 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:28.753879 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b5deb-7ade-4354-a9a7-b8d01acad709 None admin] PATH_INFO: `/v3/users` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:28.754587 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b5deb-7ade-4354-a9a7-b8d01acad709 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:28.754892 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b5deb-7ade-4354-a9a7-b8d01acad709 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:28.756308 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b5deb-7ade-4354-a9a7-b8d01acad709 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:28.765942 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939d182-0cd9-4d4d-8979-d7d6d54f9030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:28.766546 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939d182-0cd9-4d4d-8979-d7d6d54f9030 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:28.766823 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939d182-0cd9-4d4d-8979-d7d6d54f9030 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:28.767129 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939d182-0cd9-4d4d-8979-d7d6d54f9030 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:28.791046 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 260/503] 10.222.0.43 () {56 vars in 1137 bytes} [Fri Aug 19 03:51:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:28.792055 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b5deb-7ade-4354-a9a7-b8d01acad709 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:28.836134 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939d182-0cd9-4d4d-8979-d7d6d54f9030 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:28.837632 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939d182-0cd9-4d4d-8979-d7d6d54f9030 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:28.842438 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:28.878348 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:28.890730 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b5deb-7ade-4354-a9a7-b8d01acad709 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:28.926667 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50311ab3-63e3-49ca-b831-0b76424e60a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:28.927261 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50311ab3-63e3-49ca-b831-0b76424e60a6 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:28.927539 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50311ab3-63e3-49ca-b831-0b76424e60a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:28.927811 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50311ab3-63e3-49ca-b831-0b76424e60a6 None admin] PATH_INFO: `/v3/domains` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:28.928439 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50311ab3-63e3-49ca-b831-0b76424e60a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:28.928771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50311ab3-63e3-49ca-b831-0b76424e60a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:28.930156 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50311ab3-63e3-49ca-b831-0b76424e60a6 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:28.935462 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 244/504] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:51:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:51:28.936284 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939d182-0cd9-4d4d-8979-d7d6d54f9030 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:28.945387 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 261/505] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:28.945387 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50311ab3-63e3-49ca-b831-0b76424e60a6 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:29.035883 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939d182-0cd9-4d4d-8979-d7d6d54f9030 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:29.038050 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50311ab3-63e3-49ca-b831-0b76424e60a6 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:29.050695 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:29.069615 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2403b-1caf-42f5-8a96-d3ed18c389bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:29.070202 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2403b-1caf-42f5-8a96-d3ed18c389bf None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:29.070481 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2403b-1caf-42f5-8a96-d3ed18c389bf None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:29.070756 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2403b-1caf-42f5-8a96-d3ed18c389bf None admin] PATH_INFO: `/v3/users` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:29.071486 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e2403b-1caf-42f5-8a96-d3ed18c389bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:29.071776 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e2403b-1caf-42f5-8a96-d3ed18c389bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:29.072301 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866af07-c685-4676-92bf-d1e0d6132299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:29.072919 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866af07-c685-4676-92bf-d1e0d6132299 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:29.073193 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866af07-c685-4676-92bf-d1e0d6132299 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:29.073281 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e2403b-1caf-42f5-8a96-d3ed18c389bf None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:29.073467 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866af07-c685-4676-92bf-d1e0d6132299 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:29.086924 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:29.096066 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 245/506] 10.222.0.43 () {56 vars in 1137 bytes} [Fri Aug 19 03:51:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:29.096066 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2403b-1caf-42f5-8a96-d3ed18c389bf None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:29.140877 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866af07-c685-4676-92bf-d1e0d6132299 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:29.142284 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866af07-c685-4676-92bf-d1e0d6132299 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:29.194030 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2403b-1caf-42f5-8a96-d3ed18c389bf None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:29.227696 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b6005-658f-4ed4-b853-3c451254b4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:29.228315 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b6005-658f-4ed4-b853-3c451254b4e5 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:29.228617 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b6005-658f-4ed4-b853-3c451254b4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:29.228889 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b6005-658f-4ed4-b853-3c451254b4e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:29.239252 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b6005-658f-4ed4-b853-3c451254b4e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:29.240771 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b6005-658f-4ed4-b853-3c451254b4e5 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:29.245454 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 262/507] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:51:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:51:29.245454 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866af07-c685-4676-92bf-d1e0d6132299 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:29.254671 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:29.258870 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-c95b6005-658f-4ed4-b853-3c451254b4e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:29.258870 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:29.258870 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:29.258870 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:29.258870 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:29.258870 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:29.258870 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:29.258870 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:29.258870 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:29.258870 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:29.258870 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:29.258870 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:29.258870 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:29.258870 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:29.258870 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:29.258870 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:29.259786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:29.259786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:29.259786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:29.259786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:29.259786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:29.259786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:29.259786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:29.259786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:29.259786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:29.259786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:29.259786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:29.259786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:29.259786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:29.259786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:29.259786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:29.259786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:29.259786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:29.260668 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:29.260668 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:29.260668 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:29.260668 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 246/508] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:29.261414 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b6005-658f-4ed4-b853-3c451254b4e5 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:29.312576 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:29.339851 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866af07-c685-4676-92bf-d1e0d6132299 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:29.358964 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b6005-658f-4ed4-b853-3c451254b4e5 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:29.373188 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111e21e-e8f1-4dd3-8550-ce923f2e174b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:29.373806 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111e21e-e8f1-4dd3-8550-ce923f2e174b None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:29.374083 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111e21e-e8f1-4dd3-8550-ce923f2e174b None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:29.374351 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111e21e-e8f1-4dd3-8550-ce923f2e174b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:29.381062 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111e21e-e8f1-4dd3-8550-ce923f2e174b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:29.382508 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111e21e-e8f1-4dd3-8550-ce923f2e174b None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:29.391422 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c9bb2-c05e-41d4-9138-ef1254f0ddbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:29.392451 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c9bb2-c05e-41d4-9138-ef1254f0ddbe None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:29.392758 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c9bb2-c05e-41d4-9138-ef1254f0ddbe None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:29.393281 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c9bb2-c05e-41d4-9138-ef1254f0ddbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:29.394363 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-f111e21e-e8f1-4dd3-8550-ce923f2e174b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 03:51:29.394363 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:29.394363 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:29.394363 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:29.394363 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:29.394363 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:29.394363 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:29.394363 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:29.394363 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:29.394363 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:29.394363 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:29.394363 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:29.394363 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 03:51:29.394363 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 03:51:29.394363 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 03:51:29.394363 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 03:51:29.395384 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:29.395384 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:29.395384 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 03:51:29.395384 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:29.395384 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 03:51:29.395384 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:29.395384 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:29.395384 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:29.395384 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:29.395384 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:29.395384 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:29.395384 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:29.395384 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:29.395384 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:29.395384 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:29.395384 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:29.395384 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:29.395384 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:29.396299 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:29.396299 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:29.396299 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 03:51:29.396299 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 03:51:29.396299 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 03:51:29.396299 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 03:51:29.396299 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 03:51:29.396299 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 03:51:29.396299 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 03:51:29.396299 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:29.396299 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 263/509] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 03:51:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:29.396299 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111e21e-e8f1-4dd3-8550-ce923f2e174b None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:29.469360 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c9bb2-c05e-41d4-9138-ef1254f0ddbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:29.471439 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c9bb2-c05e-41d4-9138-ef1254f0ddbe None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:29.476990 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:29.507038 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111e21e-e8f1-4dd3-8550-ce923f2e174b None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:29.527996 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:29.550811 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a123f-8ec5-4313-8528-8951e66e08f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:29.551449 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a123f-8ec5-4313-8528-8951e66e08f6 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:29.551982 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a123f-8ec5-4313-8528-8951e66e08f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:29.551982 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a123f-8ec5-4313-8528-8951e66e08f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:29.562833 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a123f-8ec5-4313-8528-8951e66e08f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:29.564346 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a123f-8ec5-4313-8528-8951e66e08f6 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:29.579042 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-348a123f-8ec5-4313-8528-8951e66e08f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:29.579042 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:29.579042 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:29.579042 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:29.579042 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:29.579042 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:29.579042 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:29.579042 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:29.579042 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:29.579042 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:29.579042 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:29.579042 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:29.579042 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:29.579042 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:29.579042 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:29.579042 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:29.580613 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:29.580613 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:29.580613 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:29.580613 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:29.580613 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:29.580613 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:29.580613 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:29.580613 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:29.580613 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:29.580613 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:29.580613 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:29.580613 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:29.580613 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:29.580613 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:29.580613 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:29.580613 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:29.580613 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:29.581478 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:29.581478 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:29.581478 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:29.581478 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 264/510] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:29.581712 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 247/511] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:51:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:51:29.582114 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a123f-8ec5-4313-8528-8951e66e08f6 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:29.582187 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c9bb2-c05e-41d4-9138-ef1254f0ddbe None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:29.687003 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c9bb2-c05e-41d4-9138-ef1254f0ddbe None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:29.702600 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a123f-8ec5-4313-8528-8951e66e08f6 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:29.723490 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9487bd-e244-4b8e-a3f5-d5983358ccb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:29.724107 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9487bd-e244-4b8e-a3f5-d5983358ccb4 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:29.724387 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9487bd-e244-4b8e-a3f5-d5983358ccb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:29.724692 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9487bd-e244-4b8e-a3f5-d5983358ccb4 None admin] PATH_INFO: `/v3/users` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:29.725415 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9487bd-e244-4b8e-a3f5-d5983358ccb4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:29.725720 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9487bd-e244-4b8e-a3f5-d5983358ccb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:29.727161 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9487bd-e244-4b8e-a3f5-d5983358ccb4 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:29.727626 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:29.738712 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710b224-532f-44b0-ab8b-25e172f97637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:29.739582 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710b224-532f-44b0-ab8b-25e172f97637 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:29.739859 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710b224-532f-44b0-ab8b-25e172f97637 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:29.740132 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710b224-532f-44b0-ab8b-25e172f97637 None admin] PATH_INFO: `/v3/domains` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:29.740806 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5710b224-532f-44b0-ab8b-25e172f97637 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:29.741107 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5710b224-532f-44b0-ab8b-25e172f97637 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:29.742477 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5710b224-532f-44b0-ab8b-25e172f97637 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:29.750489 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 248/512] 10.222.0.43 () {56 vars in 1139 bytes} [Fri Aug 19 03:51:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:29.751826 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9487bd-e244-4b8e-a3f5-d5983358ccb4 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:29.760158 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 265/513] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:29.761113 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710b224-532f-44b0-ab8b-25e172f97637 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:29.770002 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:29.857892 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9487bd-e244-4b8e-a3f5-d5983358ccb4 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:29.859704 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710b224-532f-44b0-ab8b-25e172f97637 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:29.893004 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65c4e8-0b83-4dc2-bc71-3152d7dd1dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:29.893171 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f7e58-867a-4674-95eb-7f9774e8a8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:29.893619 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65c4e8-0b83-4dc2-bc71-3152d7dd1dc4 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:29.893741 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f7e58-867a-4674-95eb-7f9774e8a8f7 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:29.893887 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65c4e8-0b83-4dc2-bc71-3152d7dd1dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:29.893976 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f7e58-867a-4674-95eb-7f9774e8a8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:29.894148 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65c4e8-0b83-4dc2-bc71-3152d7dd1dc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:29.894239 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f7e58-867a-4674-95eb-7f9774e8a8f7 None admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:29.894775 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f7e58-867a-4674-95eb-7f9774e8a8f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:29.895075 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f7e58-867a-4674-95eb-7f9774e8a8f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:29.896459 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f7e58-867a-4674-95eb-7f9774e8a8f7 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:29.903899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65c4e8-0b83-4dc2-bc71-3152d7dd1dc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:29.905349 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65c4e8-0b83-4dc2-bc71-3152d7dd1dc4 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:29.907536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 249/514] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:29.908317 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f7e58-867a-4674-95eb-7f9774e8a8f7 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:29.919588 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-ef65c4e8-0b83-4dc2-bc71-3152d7dd1dc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:29.919588 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:29.919588 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:29.919588 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:29.919588 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:29.919588 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:29.919588 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:29.919588 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:29.919588 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:29.919588 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:29.919588 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:29.919588 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:29.919588 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:29.919588 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:29.919588 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:29.919588 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:29.920654 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:29.920654 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:29.920654 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:29.920654 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:29.920654 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:29.920654 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:29.920654 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:29.920654 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:29.920654 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:29.920654 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:29.920654 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:29.920654 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:29.920654 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:29.920654 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:29.920654 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:29.920654 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:29.920654 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:29.921514 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:29.921514 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:29.921514 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:29.921514 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 266/515] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:29.921514 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65c4e8-0b83-4dc2-bc71-3152d7dd1dc4 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:29.955347 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:29.981219 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:30.014016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f7e58-867a-4674-95eb-7f9774e8a8f7 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:30.020368 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65c4e8-0b83-4dc2-bc71-3152d7dd1dc4 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:30.047704 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416441b8-2eab-4cbb-9b3b-bc82b7699b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:30.048836 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416441b8-2eab-4cbb-9b3b-bc82b7699b35 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:30.049117 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416441b8-2eab-4cbb-9b3b-bc82b7699b35 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:30.049389 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416441b8-2eab-4cbb-9b3b-bc82b7699b35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:30.053747 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13239160-2f91-4b05-b2d8-7f37819a3db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:30.054369 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13239160-2f91-4b05-b2d8-7f37819a3db0 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:30.054650 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13239160-2f91-4b05-b2d8-7f37819a3db0 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:30.054924 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13239160-2f91-4b05-b2d8-7f37819a3db0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:30.062174 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13239160-2f91-4b05-b2d8-7f37819a3db0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:30.063652 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13239160-2f91-4b05-b2d8-7f37819a3db0 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:30.075997 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-13239160-2f91-4b05-b2d8-7f37819a3db0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:30.075997 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:30.075997 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:30.075997 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:30.075997 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:30.075997 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:30.075997 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:30.075997 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:30.075997 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:30.075997 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:30.075997 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:30.075997 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:30.075997 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 03:51:30.075997 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 03:51:30.075997 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 03:51:30.077109 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 03:51:30.077109 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:30.077109 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:30.077109 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:30.077109 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:30.077109 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:30.077109 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:30.077109 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:30.077109 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:30.077109 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:30.077109 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:30.077109 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:30.077109 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:30.077109 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:30.077109 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:30.077109 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:30.077109 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:30.078002 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 03:51:30.078002 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 03:51:30.078002 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 03:51:30.078002 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 03:51:30.078002 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 03:51:30.078002 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 03:51:30.078002 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:30.078002 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:30.078002 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 267/516] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:51:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:30.078002 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13239160-2f91-4b05-b2d8-7f37819a3db0 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:30.121085 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416441b8-2eab-4cbb-9b3b-bc82b7699b35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:30.122584 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416441b8-2eab-4cbb-9b3b-bc82b7699b35 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:30.172635 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:30.180133 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13239160-2f91-4b05-b2d8-7f37819a3db0 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:30.190831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:30.214361 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3f142-1ada-493e-b501-14e2feec5c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:30.214922 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3f142-1ada-493e-b501-14e2feec5c43 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:30.215205 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3f142-1ada-493e-b501-14e2feec5c43 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:30.215480 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3f142-1ada-493e-b501-14e2feec5c43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:30.222207 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3f142-1ada-493e-b501-14e2feec5c43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:30.222864 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 250/517] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:51:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:51:30.223678 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3f142-1ada-493e-b501-14e2feec5c43 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:30.223783 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416441b8-2eab-4cbb-9b3b-bc82b7699b35 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:30.236822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-7fd3f142-1ada-493e-b501-14e2feec5c43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:30.236822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:30.236822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:30.236822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:30.236822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:30.236822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:30.236822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:30.236822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:30.236822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:30.236822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:30.236822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:30.236822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:30.236822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 03:51:30.236822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 03:51:30.236822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 03:51:30.237709 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 03:51:30.237709 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:30.237709 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:30.237709 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:30.237709 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:30.237709 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:30.237709 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:30.237709 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:30.237709 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:30.237709 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:30.237709 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:30.237709 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:30.237709 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:30.237709 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:30.237709 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:30.237709 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:30.237709 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:30.238565 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 03:51:30.238565 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 03:51:30.238565 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 03:51:30.238565 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 03:51:30.238565 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 03:51:30.238565 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 03:51:30.238565 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:30.238565 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:30.238565 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 268/518] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:51:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:30.239029 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3f142-1ada-493e-b501-14e2feec5c43 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:30.324266 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416441b8-2eab-4cbb-9b3b-bc82b7699b35 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:30.335843 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3f142-1ada-493e-b501-14e2feec5c43 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:30.356905 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab75ea-a9d3-4432-bcee-e7077120d96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:30.357502 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab75ea-a9d3-4432-bcee-e7077120d96b None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:30.357780 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab75ea-a9d3-4432-bcee-e7077120d96b None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:30.358064 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab75ea-a9d3-4432-bcee-e7077120d96b None admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:30.358700 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab75ea-a9d3-4432-bcee-e7077120d96b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:30.359001 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab75ea-a9d3-4432-bcee-e7077120d96b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:30.361017 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab75ea-a9d3-4432-bcee-e7077120d96b None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:30.368397 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6373f8-8209-4e80-8058-7759d0b37174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:30.369019 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6373f8-8209-4e80-8058-7759d0b37174 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:30.369294 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6373f8-8209-4e80-8058-7759d0b37174 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:30.369560 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6373f8-8209-4e80-8058-7759d0b37174 None admin] PATH_INFO: `/v3/projects` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:30.370280 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6373f8-8209-4e80-8058-7759d0b37174 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:30.370585 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6373f8-8209-4e80-8058-7759d0b37174 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:30.371937 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 251/519] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:30.372048 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6373f8-8209-4e80-8058-7759d0b37174 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:30.372751 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab75ea-a9d3-4432-bcee-e7077120d96b None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:30.391103 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 269/520] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 03:51:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:30.391905 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6373f8-8209-4e80-8058-7759d0b37174 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:30.405400 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:30.414105 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:30.474196 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab75ea-a9d3-4432-bcee-e7077120d96b None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:30.496196 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6373f8-8209-4e80-8058-7759d0b37174 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:30.506479 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95ca60-4fc2-4346-93be-cf47011f1b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:30.507124 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95ca60-4fc2-4346-93be-cf47011f1b8c None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:30.507408 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95ca60-4fc2-4346-93be-cf47011f1b8c None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:30.507679 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95ca60-4fc2-4346-93be-cf47011f1b8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:30.518083 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95ca60-4fc2-4346-93be-cf47011f1b8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:30.519518 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95ca60-4fc2-4346-93be-cf47011f1b8c None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:30.528553 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b4734-3b01-44e7-a26b-c82081bb37f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:30.529152 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b4734-3b01-44e7-a26b-c82081bb37f3 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:30.529433 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b4734-3b01-44e7-a26b-c82081bb37f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:30.529706 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b4734-3b01-44e7-a26b-c82081bb37f3 None admin] PATH_INFO: `/v3/projects` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:30.530381 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b4734-3b01-44e7-a26b-c82081bb37f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:30.530683 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b4734-3b01-44e7-a26b-c82081bb37f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:30.532099 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b4734-3b01-44e7-a26b-c82081bb37f3 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:30.533536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-3b95ca60-4fc2-4346-93be-cf47011f1b8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:30.533536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:30.533536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:30.533536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:30.533536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:30.533536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:30.533536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:30.533536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:30.533536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:30.533536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:30.533536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:30.533536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:30.533536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:30.533536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:30.533536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:30.533536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:30.534497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:30.534497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:30.534497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:30.534497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:30.534497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:30.534497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:30.534497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:30.534497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:30.534497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:30.534497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:30.534497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:30.534497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:30.534497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:30.534497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:30.534497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:30.534497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:30.534497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:30.535362 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:30.535362 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:30.535362 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:30.535362 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 252/521] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:30.535362 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95ca60-4fc2-4346-93be-cf47011f1b8c None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:30.548914 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 270/522] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 03:51:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:30.549735 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b4734-3b01-44e7-a26b-c82081bb37f3 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:30.623278 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:30.629087 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:30.641386 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95ca60-4fc2-4346-93be-cf47011f1b8c None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:30.652223 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b4734-3b01-44e7-a26b-c82081bb37f3 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:30.675323 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c57e22-b8a6-408c-9aa6-34634607d5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:30.675947 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c57e22-b8a6-408c-9aa6-34634607d5b7 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:30.676229 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c57e22-b8a6-408c-9aa6-34634607d5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:30.676537 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c57e22-b8a6-408c-9aa6-34634607d5b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:30.683061 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c57e22-b8a6-408c-9aa6-34634607d5b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:30.684551 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c57e22-b8a6-408c-9aa6-34634607d5b7 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:30.685844 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1868a-5887-4206-a8c5-4a03baaebec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:30.686441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1868a-5887-4206-a8c5-4a03baaebec8 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:30.686724 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1868a-5887-4206-a8c5-4a03baaebec8 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:30.687004 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1868a-5887-4206-a8c5-4a03baaebec8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:30.687709 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1868a-5887-4206-a8c5-4a03baaebec8 None admin] RBAC: Adding query filter params (role.id=ad0744b06a1644a5bbbe3f145f6ac4e0, scope.project.id=b09192159c884e73bef832a38e2d5e7c, user.id=7aab3a88f9d0401db32fbaadef2711ee) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:30.688016 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1868a-5887-4206-a8c5-4a03baaebec8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:30.689504 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1868a-5887-4206-a8c5-4a03baaebec8 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:30.694927 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 271/523] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:51:30 2022] GET /identity/v3/role_assignments?user.id=7aab3a88f9d0401db32fbaadef2711ee&scope.project.id=b09192159c884e73bef832a38e2d5e7c&role.id=ad0744b06a1644a5bbbe3f145f6ac4e0 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:30.695460 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1868a-5887-4206-a8c5-4a03baaebec8 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:30.696928 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-63c57e22-b8a6-408c-9aa6-34634607d5b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:30.696928 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:30.696928 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:30.696928 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:30.696928 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:30.696928 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:30.696928 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:30.696928 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:30.696928 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:30.696928 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:30.696928 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:30.696928 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:30.696928 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 03:51:30.696928 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 03:51:30.696928 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 03:51:30.697771 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 03:51:30.697771 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:30.697771 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:30.697771 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:30.697771 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:30.697771 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:30.697771 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:30.697771 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:30.697771 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:30.697771 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:30.697771 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:30.697771 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:30.697771 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:30.697771 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:30.697771 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:30.697771 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:30.697771 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:30.698690 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 03:51:30.698690 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 03:51:30.698690 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 03:51:30.698690 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 03:51:30.698690 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 03:51:30.698690 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 03:51:30.698690 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:30.698690 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:30.698690 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 253/524] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:51:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:30.699931 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c57e22-b8a6-408c-9aa6-34634607d5b7 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:30.815316 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1868a-5887-4206-a8c5-4a03baaebec8 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:30.818297 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c57e22-b8a6-408c-9aa6-34634607d5b7 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:30.854884 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa348e9-6f90-4321-8ff7-35a32c59b546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:30.855639 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa348e9-6f90-4321-8ff7-35a32c59b546 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:30.855921 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa348e9-6f90-4321-8ff7-35a32c59b546 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:30.856197 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa348e9-6f90-4321-8ff7-35a32c59b546 None admin] PATH_INFO: `/v3/domains` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:30.856800 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0b56e-b128-4c88-b0e1-385cf7cf3c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:30.856915 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa348e9-6f90-4321-8ff7-35a32c59b546 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:30.857176 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa348e9-6f90-4321-8ff7-35a32c59b546 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:30.857413 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0b56e-b128-4c88-b0e1-385cf7cf3c4b None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:30.857693 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0b56e-b128-4c88-b0e1-385cf7cf3c4b None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:30.857967 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0b56e-b128-4c88-b0e1-385cf7cf3c4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:30.858590 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa348e9-6f90-4321-8ff7-35a32c59b546 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:30.858687 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f0b56e-b128-4c88-b0e1-385cf7cf3c4b None admin] RBAC: Adding query filter params (role.id=ad0744b06a1644a5bbbe3f145f6ac4e0, scope.project.id=b09192159c884e73bef832a38e2d5e7c, user.id=6e8bf3b9cdd9431398a088815a44c8bb) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:30.858991 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f0b56e-b128-4c88-b0e1-385cf7cf3c4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:30.860419 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f0b56e-b128-4c88-b0e1-385cf7cf3c4b None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:30.876676 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 254/525] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:51:30 2022] GET /identity/v3/role_assignments?user.id=6e8bf3b9cdd9431398a088815a44c8bb&scope.project.id=b09192159c884e73bef832a38e2d5e7c&role.id=ad0744b06a1644a5bbbe3f145f6ac4e0 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:30.876676 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0b56e-b128-4c88-b0e1-385cf7cf3c4b None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:30.878252 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:30.882805 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 272/526] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:30.888716 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:30.897588 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa348e9-6f90-4321-8ff7-35a32c59b546 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:31.009771 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0b56e-b128-4c88-b0e1-385cf7cf3c4b None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:31.047616 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e728caa-8662-4e67-8c10-419165bd311e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:31.048270 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e728caa-8662-4e67-8c10-419165bd311e None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:31.050271 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e728caa-8662-4e67-8c10-419165bd311e None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:31.050271 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e728caa-8662-4e67-8c10-419165bd311e None admin] PATH_INFO: `/v3/projects` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:31.050441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa348e9-6f90-4321-8ff7-35a32c59b546 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:31.050517 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e728caa-8662-4e67-8c10-419165bd311e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:31.050737 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e728caa-8662-4e67-8c10-419165bd311e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:31.054345 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e728caa-8662-4e67-8c10-419165bd311e None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:31.076318 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 255/527] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 03:51:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:31.077185 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e728caa-8662-4e67-8c10-419165bd311e None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:31.094401 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980348bd-ee33-4928-902f-10fb8159bacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:31.095871 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980348bd-ee33-4928-902f-10fb8159bacd None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:31.096149 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980348bd-ee33-4928-902f-10fb8159bacd None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:31.096420 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980348bd-ee33-4928-902f-10fb8159bacd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:31.105295 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980348bd-ee33-4928-902f-10fb8159bacd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:31.107223 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980348bd-ee33-4928-902f-10fb8159bacd None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:31.121678 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-980348bd-ee33-4928-902f-10fb8159bacd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:31.121678 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:31.121678 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:31.121678 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:31.121678 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:31.121678 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:31.121678 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:31.121678 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:31.121678 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:31.121678 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:31.121678 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:31.121678 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:31.121678 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 03:51:31.121678 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 03:51:31.121678 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 03:51:31.122578 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 03:51:31.122578 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:31.122578 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:31.122578 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:31.122578 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:31.122578 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:31.122578 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:31.122578 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:31.122578 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:31.122578 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:31.122578 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:31.122578 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:31.122578 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:31.122578 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:31.122578 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:31.122578 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:31.122578 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:31.123445 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 03:51:31.123445 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 03:51:31.123445 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 03:51:31.123445 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 03:51:31.123445 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 03:51:31.123445 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 03:51:31.123445 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:31.123445 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:31.123445 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 273/528] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:51:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:31.129315 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980348bd-ee33-4928-902f-10fb8159bacd None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:31.166334 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:31.213931 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e728caa-8662-4e67-8c10-419165bd311e None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:31.217488 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:31.254444 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a70781-b878-43ad-a759-4cdbf7bf26af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:31.255509 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a70781-b878-43ad-a759-4cdbf7bf26af None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:31.255973 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a70781-b878-43ad-a759-4cdbf7bf26af None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:31.256384 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a70781-b878-43ad-a759-4cdbf7bf26af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:31.257256 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a70781-b878-43ad-a759-4cdbf7bf26af None admin] RBAC: Adding query filter params (role.id=ad0744b06a1644a5bbbe3f145f6ac4e0, scope.project.id=b09192159c884e73bef832a38e2d5e7c, user.id=cfee7b193add48478b5240198b1aa602) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:31.257717 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a70781-b878-43ad-a759-4cdbf7bf26af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:31.259488 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a70781-b878-43ad-a759-4cdbf7bf26af None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:31.261823 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980348bd-ee33-4928-902f-10fb8159bacd None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:31.266055 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 256/529] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:51:31 2022] GET /identity/v3/role_assignments?user.id=cfee7b193add48478b5240198b1aa602&scope.project.id=b09192159c884e73bef832a38e2d5e7c&role.id=ad0744b06a1644a5bbbe3f145f6ac4e0 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:31.305540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d4628-4423-4605-916e-6c05f220e17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:31.306327 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d4628-4423-4605-916e-6c05f220e17e None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:31.306703 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d4628-4423-4605-916e-6c05f220e17e None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:31.307157 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d4628-4423-4605-916e-6c05f220e17e None admin] PATH_INFO: `/v3/projects` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:31.307979 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d4628-4423-4605-916e-6c05f220e17e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:31.308388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d4628-4423-4605-916e-6c05f220e17e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:31.310133 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d4628-4423-4605-916e-6c05f220e17e None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:31.324936 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 274/530] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 03:51:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:31.331620 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a70781-b878-43ad-a759-4cdbf7bf26af None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:31.445355 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a70781-b878-43ad-a759-4cdbf7bf26af None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:31.475551 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:31.482791 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb6b15-ebcd-4996-8cf9-863d0ed9f24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:31.483607 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb6b15-ebcd-4996-8cf9-863d0ed9f24f None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:31.484023 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb6b15-ebcd-4996-8cf9-863d0ed9f24f None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:31.484429 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb6b15-ebcd-4996-8cf9-863d0ed9f24f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:31.485845 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb6b15-ebcd-4996-8cf9-863d0ed9f24f None admin] RBAC: Adding query filter params (role.id=ad0744b06a1644a5bbbe3f145f6ac4e0, scope.project.id=b09192159c884e73bef832a38e2d5e7c, user.id=00454605826e4d6593d2d6aa331ebdc6) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:31.486394 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb6b15-ebcd-4996-8cf9-863d0ed9f24f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:31.487953 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb6b15-ebcd-4996-8cf9-863d0ed9f24f None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:31.494121 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 257/531] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:51:31 2022] GET /identity/v3/role_assignments?user.id=00454605826e4d6593d2d6aa331ebdc6&scope.project.id=b09192159c884e73bef832a38e2d5e7c&role.id=ad0744b06a1644a5bbbe3f145f6ac4e0 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:32.887209 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc436fd-9424-4743-a394-e18e2d3cb305 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:32.887722 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc436fd-9424-4743-a394-e18e2d3cb305 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:32.887834 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc436fd-9424-4743-a394-e18e2d3cb305 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:32.889515 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 275/532] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:32.896019 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15393c8-60eb-4442-875d-a1cfd74dd384 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:32.896407 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15393c8-60eb-4442-875d-a1cfd74dd384 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:32.896605 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15393c8-60eb-4442-875d-a1cfd74dd384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:32.914813 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-a15393c8-60eb-4442-875d-a1cfd74dd384 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:32.916006 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-a15393c8-60eb-4442-875d-a1cfd74dd384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:32.995873 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 258/533] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:33.118286 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d234a-2c5c-46ad-8ae3-6ebf32fce225 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:33.118675 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d234a-2c5c-46ad-8ae3-6ebf32fce225 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:33.119028 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d234a-2c5c-46ad-8ae3-6ebf32fce225 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:33.120805 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 276/534] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:33.126100 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252929d1-5ba7-41fc-be47-f8b5c823864e None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:33.126386 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252929d1-5ba7-41fc-be47-f8b5c823864e None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:33.126661 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252929d1-5ba7-41fc-be47-f8b5c823864e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:33.146759 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-252929d1-5ba7-41fc-be47-f8b5c823864e None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:33.147887 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-252929d1-5ba7-41fc-be47-f8b5c823864e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:33.222335 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 259/535] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 03:51:33.333310 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d234a-2c5c-46ad-8ae3-6ebf32fce225 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:33.429378 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e601c-eb0c-428c-88df-daa17cd35902 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:33.429562 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e601c-eb0c-428c-88df-daa17cd35902 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:33.429830 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e601c-eb0c-428c-88df-daa17cd35902 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:33.431369 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 260/536] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:33.436342 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cc980-8d02-4a78-8e3c-74e93d2d384e None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:33.436665 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cc980-8d02-4a78-8e3c-74e93d2d384e None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:33.436939 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cc980-8d02-4a78-8e3c-74e93d2d384e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:33.443834 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d234a-2c5c-46ad-8ae3-6ebf32fce225 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:33.456675 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-f80cc980-8d02-4a78-8e3c-74e93d2d384e None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:33.458346 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-f80cc980-8d02-4a78-8e3c-74e93d2d384e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:33.464654 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:33.479301 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb344a-822c-436f-96b8-9f36cd8b5725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:33.479933 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb344a-822c-436f-96b8-9f36cd8b5725 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:33.480219 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb344a-822c-436f-96b8-9f36cd8b5725 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:33.480520 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb344a-822c-436f-96b8-9f36cd8b5725 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:33.491562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb344a-822c-436f-96b8-9f36cd8b5725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:33.496261 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-2bbb344a-822c-436f-96b8-9f36cd8b5725 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:51:33.496261 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:33.496261 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:33.496261 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:33.496261 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:33.496261 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:33.496261 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:33.496261 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:33.496261 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:33.496261 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:33.496261 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:33.496261 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:33.496261 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:33.496261 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:33.496261 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:33.496261 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:33.497190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:33.497190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:33.497190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:33.497190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:33.497190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:33.497190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:33.497190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:33.497190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:33.497190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:33.497190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:33.497190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:33.497190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:33.497190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:33.497190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:33.497190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:33.497190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:33.498014 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:33.498014 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:33.498014 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:33.498014 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:33.498014 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:33.498014 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:33.498014 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:33.498014 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:33.498014 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:33.498014 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:33.498014 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:51:33.498014 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:33.498014 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 277/537] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 03:51:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:33.505384 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb344a-822c-436f-96b8-9f36cd8b5725 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:33.528512 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:33.556626 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 261/538] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 03:51:33.577193 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80cc980-8d02-4a78-8e3c-74e93d2d384e None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:33.631498 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb344a-822c-436f-96b8-9f36cd8b5725 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:33.671900 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcfee2-4f5c-441e-866f-28dcdac28df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:33.672888 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcfee2-4f5c-441e-866f-28dcdac28df0 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:33.673391 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcfee2-4f5c-441e-866f-28dcdac28df0 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:33.673860 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcfee2-4f5c-441e-866f-28dcdac28df0 None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:33.674710 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dcfee2-4f5c-441e-866f-28dcdac28df0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:33.675205 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dcfee2-4f5c-441e-866f-28dcdac28df0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:33.676808 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dcfee2-4f5c-441e-866f-28dcdac28df0 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:33.691127 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 278/539] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 03:51:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:33.692695 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcfee2-4f5c-441e-866f-28dcdac28df0 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:33.697261 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80cc980-8d02-4a78-8e3c-74e93d2d384e None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:33.740936 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa5237-0d31-4981-adfd-af09e97d324f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:33.741567 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa5237-0d31-4981-adfd-af09e97d324f None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:33.741838 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa5237-0d31-4981-adfd-af09e97d324f None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:33.742107 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa5237-0d31-4981-adfd-af09e97d324f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:33.744461 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:33.753833 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa5237-0d31-4981-adfd-af09e97d324f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:33.758439 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-9dfa5237-0d31-4981-adfd-af09e97d324f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:51:33.758439 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:33.758439 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:33.758439 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:33.758439 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:33.758439 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:33.758439 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:33.758439 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:33.758439 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:33.758439 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:33.758439 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:33.758439 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:33.758439 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:33.758439 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:33.758439 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:33.758439 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:33.759341 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:33.759341 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:33.759341 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:33.759341 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:33.759341 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:33.759341 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:33.759341 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:33.759341 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:33.759341 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:33.759341 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:33.759341 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:33.759341 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:33.759341 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:33.759341 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:33.759341 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:33.759341 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:33.760144 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:33.760144 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:33.760144 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:33.760144 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:33.760144 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:33.760144 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:33.760144 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:33.760144 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:33.760144 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:33.760144 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:33.760144 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:51:33.760144 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:33.760144 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 262/540] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 03:51:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:33.761238 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e08bc9-eb7c-43ee-8617-902757929b1c None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:33.761238 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e08bc9-eb7c-43ee-8617-902757929b1c None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:33.761238 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e08bc9-eb7c-43ee-8617-902757929b1c None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:33.762651 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 263/541] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:33.764958 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e08bc9-eb7c-43ee-8617-902757929b1c None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:33.815560 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcfee2-4f5c-441e-866f-28dcdac28df0 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:33.818914 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:33.851419 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16ec5b-040a-4ad3-8696-259e9fda9891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:33.852040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16ec5b-040a-4ad3-8696-259e9fda9891 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:33.852315 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16ec5b-040a-4ad3-8696-259e9fda9891 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:33.853884 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16ec5b-040a-4ad3-8696-259e9fda9891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:33.866913 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16ec5b-040a-4ad3-8696-259e9fda9891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:33.868378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16ec5b-040a-4ad3-8696-259e9fda9891 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:33.881874 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e08bc9-eb7c-43ee-8617-902757929b1c None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:33.883626 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-ec16ec5b-040a-4ad3-8696-259e9fda9891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:33.883626 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:33.883626 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:33.883626 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:33.883626 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:33.883626 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:33.883626 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:33.883626 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:33.883626 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:33.883626 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:33.883626 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:33.883626 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:33.883626 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:33.883626 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:33.883626 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:33.883626 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:33.884715 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:33.884715 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:33.884715 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:33.884715 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:33.884715 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:33.884715 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:33.884715 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:33.884715 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:33.884715 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:33.884715 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:33.884715 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:33.884715 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:33.884715 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:33.884715 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:33.884715 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:33.884715 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:33.884715 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:33.885762 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:33.885762 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:33.885762 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:33.889491 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 279/542] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 03:51:33.891116 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2f8c4-86e6-426a-ad53-787e14b94314 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:33.891396 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2f8c4-86e6-426a-ad53-787e14b94314 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:33.891666 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2f8c4-86e6-426a-ad53-787e14b94314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:33.910407 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-aea2f8c4-86e6-426a-ad53-787e14b94314 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:33.911625 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-aea2f8c4-86e6-426a-ad53-787e14b94314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:33.920182 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb51912-8721-4629-b0b5-3b3f3ce1161c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:33.920816 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb51912-8721-4629-b0b5-3b3f3ce1161c None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:33.921126 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb51912-8721-4629-b0b5-3b3f3ce1161c None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:33.921400 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb51912-8721-4629-b0b5-3b3f3ce1161c None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:33.922055 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb51912-8721-4629-b0b5-3b3f3ce1161c None admin] RBAC: Adding query filter params (name=service) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:33.922918 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb51912-8721-4629-b0b5-3b3f3ce1161c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:33.924278 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb51912-8721-4629-b0b5-3b3f3ce1161c None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:33.932195 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 264/543] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 03:51:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:33.932996 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb51912-8721-4629-b0b5-3b3f3ce1161c None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:33.977322 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 280/544] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:33.978084 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2f8c4-86e6-426a-ad53-787e14b94314 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:34.004328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:34.039538 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb51912-8721-4629-b0b5-3b3f3ce1161c None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:34.051292 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:34.078828 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd42f1-560e-4978-a4d8-b0a3d0306819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:34.079455 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd42f1-560e-4978-a4d8-b0a3d0306819 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:34.079730 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd42f1-560e-4978-a4d8-b0a3d0306819 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:34.080186 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd42f1-560e-4978-a4d8-b0a3d0306819 None admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:34.080706 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd42f1-560e-4978-a4d8-b0a3d0306819 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:34.081010 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd42f1-560e-4978-a4d8-b0a3d0306819 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:34.082365 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd42f1-560e-4978-a4d8-b0a3d0306819 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:34.083258 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2f8c4-86e6-426a-ad53-787e14b94314 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:34.094260 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 265/545] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:34.094995 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd42f1-560e-4978-a4d8-b0a3d0306819 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:34.122678 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7cb56-fa9c-46bd-8962-3a204bd9451b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:34.123307 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7cb56-fa9c-46bd-8962-3a204bd9451b None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:34.123590 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7cb56-fa9c-46bd-8962-3a204bd9451b None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:34.123871 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7cb56-fa9c-46bd-8962-3a204bd9451b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:34.134548 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7cb56-fa9c-46bd-8962-3a204bd9451b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:34.139211 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-2df7cb56-fa9c-46bd-8962-3a204bd9451b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:51:34.139211 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:34.139211 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:34.139211 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:34.139211 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:34.139211 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:34.139211 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:34.139211 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:34.139211 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:34.139211 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:34.139211 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:34.139211 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:34.139211 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:34.139211 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:34.139211 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:34.139211 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:34.140102 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:34.140102 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:34.140102 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:34.140102 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:34.140102 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:34.140102 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:34.140102 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:34.140102 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:34.140102 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:34.140102 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:34.140102 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:34.140102 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:34.140102 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:34.140102 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:34.140102 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:34.140102 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:34.141275 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:34.141275 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:34.141275 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:34.141275 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:34.141275 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:34.141275 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:34.141275 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:34.141275 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:34.141275 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:34.141275 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:34.141275 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:51:34.141275 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:34.141275 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 281/546] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 03:51:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:34.141275 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7cb56-fa9c-46bd-8962-3a204bd9451b None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:34.216863 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd42f1-560e-4978-a4d8-b0a3d0306819 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:34.238866 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:34.255030 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb2dd3-f0aa-423b-828c-d25075807ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:34.255655 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb2dd3-f0aa-423b-828c-d25075807ac9 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:34.255892 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7cb56-fa9c-46bd-8962-3a204bd9451b None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:34.255996 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb2dd3-f0aa-423b-828c-d25075807ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:34.256255 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb2dd3-f0aa-423b-828c-d25075807ac9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:34.266571 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb2dd3-f0aa-423b-828c-d25075807ac9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:34.268288 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb2dd3-f0aa-423b-828c-d25075807ac9 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:34.282999 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-26fb2dd3-f0aa-423b-828c-d25075807ac9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:34.282999 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:34.282999 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:34.282999 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:34.282999 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:34.282999 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:34.282999 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:34.282999 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:34.282999 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:34.282999 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:34.282999 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:34.282999 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:34.282999 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:34.282999 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:34.282999 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:34.282999 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:34.283907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:34.283907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:34.283907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:34.283907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:34.283907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:34.283907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:34.283907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:34.283907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:34.283907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:34.283907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:34.283907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:34.283907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:34.283907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:34.283907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:34.283907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:34.283907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:34.283907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:34.285444 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:34.285444 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:34.285444 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:34.285444 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 266/547] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:34.285444 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb2dd3-f0aa-423b-828c-d25075807ac9 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:34.300873 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d0cb6-5646-489b-8c75-bfd85d019a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:34.301626 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d0cb6-5646-489b-8c75-bfd85d019a0a None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:34.301904 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d0cb6-5646-489b-8c75-bfd85d019a0a None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:34.302184 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d0cb6-5646-489b-8c75-bfd85d019a0a None admin] PATH_INFO: `/v3/users/nova` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:34.305866 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:34.310298 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d0cb6-5646-489b-8c75-bfd85d019a0a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:34.311829 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d0cb6-5646-489b-8c75-bfd85d019a0a None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:34.323451 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-420d0cb6-5646-489b-8c75-bfd85d019a0a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 03:51:34.323451 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:34.323451 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:34.323451 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:34.323451 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:34.323451 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:34.323451 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:34.323451 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:34.323451 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:34.323451 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:34.323451 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:34.323451 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:34.323451 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 03:51:34.323451 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 03:51:34.323451 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 03:51:34.323451 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 03:51:34.329234 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:34.329234 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:34.329234 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 03:51:34.329234 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:34.329234 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 03:51:34.329234 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:34.329234 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:34.329234 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:34.329234 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:34.329234 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:34.329234 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:34.329234 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:34.329234 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:34.329234 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:34.329234 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:34.329234 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:34.329234 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:34.329234 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:34.330441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:34.330441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:34.330441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 03:51:34.330441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 03:51:34.330441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 03:51:34.330441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 03:51:34.330441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 03:51:34.330441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 03:51:34.330441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 03:51:34.330441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:34.330441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 282/548] 10.222.0.43 () {56 vars in 1093 bytes} [Fri Aug 19 03:51:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:34.330441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d0cb6-5646-489b-8c75-bfd85d019a0a None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:34.391444 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb2dd3-f0aa-423b-828c-d25075807ac9 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:34.424952 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d0cb6-5646-489b-8c75-bfd85d019a0a None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:34.425852 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2508d5-aea0-45db-b579-71a98b16b885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:34.426460 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2508d5-aea0-45db-b579-71a98b16b885 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:34.426742 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2508d5-aea0-45db-b579-71a98b16b885 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:34.427692 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2508d5-aea0-45db-b579-71a98b16b885 None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:34.427692 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2508d5-aea0-45db-b579-71a98b16b885 None admin] RBAC: Adding query filter params (name=service) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:34.427971 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2508d5-aea0-45db-b579-71a98b16b885 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:34.429371 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2508d5-aea0-45db-b579-71a98b16b885 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:34.437201 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 267/549] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 03:51:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:34.438012 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2508d5-aea0-45db-b579-71a98b16b885 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:34.457955 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20ceaa-69e9-4bb5-98de-aae46fb38929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:34.458580 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20ceaa-69e9-4bb5-98de-aae46fb38929 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:34.458856 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20ceaa-69e9-4bb5-98de-aae46fb38929 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:34.459130 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20ceaa-69e9-4bb5-98de-aae46fb38929 None admin] PATH_INFO: `/v3/domains` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:34.459752 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20ceaa-69e9-4bb5-98de-aae46fb38929 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:34.460048 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20ceaa-69e9-4bb5-98de-aae46fb38929 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:34.461433 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20ceaa-69e9-4bb5-98de-aae46fb38929 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:34.473197 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 283/550] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:34.473197 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20ceaa-69e9-4bb5-98de-aae46fb38929 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:34.479395 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:34.522832 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:34.541990 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2508d5-aea0-45db-b579-71a98b16b885 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:34.573445 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20ceaa-69e9-4bb5-98de-aae46fb38929 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:34.579540 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8b6e8-0dec-466b-8876-abe453c4a65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:34.580158 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8b6e8-0dec-466b-8876-abe453c4a65e None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:34.580438 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8b6e8-0dec-466b-8876-abe453c4a65e None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:34.580741 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8b6e8-0dec-466b-8876-abe453c4a65e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:34.590698 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8b6e8-0dec-466b-8876-abe453c4a65e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:34.596446 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-a0b8b6e8-0dec-466b-8876-abe453c4a65e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:51:34.596446 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:34.596446 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:34.596446 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:34.596446 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:34.596446 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:34.596446 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:34.596446 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:34.596446 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:34.596446 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:34.596446 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:34.596446 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:34.596446 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:34.596446 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:34.596446 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:34.596446 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:34.597373 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:34.597373 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:34.597373 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:34.597373 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:34.597373 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:34.597373 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:34.597373 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:34.597373 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:34.597373 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:34.597373 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:34.597373 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:34.597373 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:34.597373 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:34.597373 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:34.597373 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:34.597373 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:34.598184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:34.598184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:34.598184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:34.598184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:34.598184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:34.598184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:34.598184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:34.598184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:34.598184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:34.598184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:34.598184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:51:34.598184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:34.598184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 268/551] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 03:51:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:34.599392 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8b6e8-0dec-466b-8876-abe453c4a65e None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:34.611126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddb062-2f0f-43ec-a636-b7f50bd3582b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:34.611947 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddb062-2f0f-43ec-a636-b7f50bd3582b None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:34.612060 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddb062-2f0f-43ec-a636-b7f50bd3582b None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:34.612252 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddb062-2f0f-43ec-a636-b7f50bd3582b None admin] PATH_INFO: `/v3/users` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:34.613064 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ddb062-2f0f-43ec-a636-b7f50bd3582b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:34.613359 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ddb062-2f0f-43ec-a636-b7f50bd3582b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:34.614776 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ddb062-2f0f-43ec-a636-b7f50bd3582b None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:34.631728 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 284/552] 10.222.0.43 () {56 vars in 1133 bytes} [Fri Aug 19 03:51:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:34.632850 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddb062-2f0f-43ec-a636-b7f50bd3582b None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:34.695055 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:34.700652 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8b6e8-0dec-466b-8876-abe453c4a65e None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:34.733992 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddb062-2f0f-43ec-a636-b7f50bd3582b None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:34.734182 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544fe66-3c51-4634-8203-0059a9cd2e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:34.734760 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544fe66-3c51-4634-8203-0059a9cd2e18 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:34.735046 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544fe66-3c51-4634-8203-0059a9cd2e18 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:34.735326 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544fe66-3c51-4634-8203-0059a9cd2e18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:34.744210 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:34.746845 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544fe66-3c51-4634-8203-0059a9cd2e18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:34.748636 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544fe66-3c51-4634-8203-0059a9cd2e18 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:34.762541 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-7544fe66-3c51-4634-8203-0059a9cd2e18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:34.762541 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:34.762541 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:34.762541 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:34.762541 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:34.762541 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:34.762541 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:34.762541 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:34.762541 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:34.762541 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:34.762541 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:34.762541 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:34.762541 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:34.762541 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:34.762541 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:34.762541 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:34.763500 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:34.763500 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:34.763500 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:34.763500 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:34.763500 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:34.763500 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:34.763500 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:34.763500 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:34.763500 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:34.763500 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:34.763500 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:34.763500 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:34.763500 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:34.763500 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:34.763500 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:34.763500 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:34.763500 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:34.770507 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:34.770507 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:34.770507 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:34.770507 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 269/553] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:34.770507 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544fe66-3c51-4634-8203-0059a9cd2e18 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:34.770792 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00db69-0de8-41c6-9bbc-8257d1e434e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:34.770792 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00db69-0de8-41c6-9bbc-8257d1e434e1 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:34.770792 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00db69-0de8-41c6-9bbc-8257d1e434e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:34.770792 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00db69-0de8-41c6-9bbc-8257d1e434e1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:34.776901 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00db69-0de8-41c6-9bbc-8257d1e434e1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:34.778285 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00db69-0de8-41c6-9bbc-8257d1e434e1 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:34.789450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-ef00db69-0de8-41c6-9bbc-8257d1e434e1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 03:51:34.789450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:34.789450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:34.789450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:34.789450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:34.789450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:34.789450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:34.789450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:34.789450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:34.789450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:34.789450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:34.789450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:34.789450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 03:51:34.789450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 03:51:34.789450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 03:51:34.789450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 03:51:34.790742 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:34.790742 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:34.790742 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 03:51:34.790742 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:34.790742 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 03:51:34.790742 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:34.790742 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:34.790742 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:34.790742 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:34.790742 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:34.790742 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:34.790742 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:34.790742 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:34.790742 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:34.790742 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:34.790742 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:34.790742 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:34.790742 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:34.791685 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:34.791685 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:34.791685 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 03:51:34.791685 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 03:51:34.791685 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 03:51:34.791685 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 03:51:34.791685 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 03:51:34.791685 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 03:51:34.791685 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 03:51:34.791685 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:34.791685 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 285/554] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:51:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:34.791685 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00db69-0de8-41c6-9bbc-8257d1e434e1 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:34.868125 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544fe66-3c51-4634-8203-0059a9cd2e18 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:34.889933 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00db69-0de8-41c6-9bbc-8257d1e434e1 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:34.900893 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c8494-f641-4752-9dd9-e87d8a89d938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:34.901480 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c8494-f641-4752-9dd9-e87d8a89d938 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:34.901755 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c8494-f641-4752-9dd9-e87d8a89d938 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:34.902023 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c8494-f641-4752-9dd9-e87d8a89d938 None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:34.902758 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c8494-f641-4752-9dd9-e87d8a89d938 None admin] RBAC: Adding query filter params (name=service) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:34.902959 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c8494-f641-4752-9dd9-e87d8a89d938 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:34.904364 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c8494-f641-4752-9dd9-e87d8a89d938 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:34.912504 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 270/555] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 03:51:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:34.913085 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:34.913335 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c8494-f641-4752-9dd9-e87d8a89d938 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:34.927812 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa525a38-4853-40e4-9963-1dd0630bf145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:34.928445 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa525a38-4853-40e4-9963-1dd0630bf145 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:34.928751 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa525a38-4853-40e4-9963-1dd0630bf145 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:34.929021 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa525a38-4853-40e4-9963-1dd0630bf145 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:34.939285 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa525a38-4853-40e4-9963-1dd0630bf145 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:34.940750 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa525a38-4853-40e4-9963-1dd0630bf145 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:34.954135 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-aa525a38-4853-40e4-9963-1dd0630bf145 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:34.954135 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:34.954135 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:34.954135 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:34.954135 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:34.954135 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:34.954135 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:34.954135 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:34.954135 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:34.954135 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:34.954135 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:34.954135 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:34.954135 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:34.954135 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:34.954135 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:34.954135 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:34.959598 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:34.959598 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:34.959598 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:34.959598 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:34.959598 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:34.959598 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:34.959598 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:34.959598 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:34.959598 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:34.959598 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:34.959598 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:34.959598 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:34.959598 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:34.959598 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:34.959598 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:34.959598 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:34.959598 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:34.960753 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:34.960753 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:34.960753 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:34.960753 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 286/556] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:34.960753 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa525a38-4853-40e4-9963-1dd0630bf145 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:34.975169 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:35.021291 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c8494-f641-4752-9dd9-e87d8a89d938 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:35.055427 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efae8f-6847-4618-a834-8f22adf48dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:35.055588 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa525a38-4853-40e4-9963-1dd0630bf145 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:35.056090 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efae8f-6847-4618-a834-8f22adf48dc0 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:35.056458 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efae8f-6847-4618-a834-8f22adf48dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:35.056833 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efae8f-6847-4618-a834-8f22adf48dc0 None admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:35.057532 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48efae8f-6847-4618-a834-8f22adf48dc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:35.057910 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48efae8f-6847-4618-a834-8f22adf48dc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:35.059378 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48efae8f-6847-4618-a834-8f22adf48dc0 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:35.070827 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 271/557] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:35.071608 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efae8f-6847-4618-a834-8f22adf48dc0 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:35.088130 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63b39c-bf3c-4706-a242-a0c4d02212a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:35.088769 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63b39c-bf3c-4706-a242-a0c4d02212a2 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:35.089049 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63b39c-bf3c-4706-a242-a0c4d02212a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:35.089325 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63b39c-bf3c-4706-a242-a0c4d02212a2 None admin] PATH_INFO: `/v3/users` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:35.090040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63b39c-bf3c-4706-a242-a0c4d02212a2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:35.090352 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63b39c-bf3c-4706-a242-a0c4d02212a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:35.091788 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63b39c-bf3c-4706-a242-a0c4d02212a2 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:35.108990 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 287/558] 10.222.0.43 () {56 vars in 1137 bytes} [Fri Aug 19 03:51:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:35.110327 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63b39c-bf3c-4706-a242-a0c4d02212a2 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:35.139263 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:35.174247 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efae8f-6847-4618-a834-8f22adf48dc0 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:35.189094 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:35.210216 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d15350-bb55-4fd9-bd6b-75694b830f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:35.210844 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d15350-bb55-4fd9-bd6b-75694b830f98 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:35.211124 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d15350-bb55-4fd9-bd6b-75694b830f98 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:35.211397 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d15350-bb55-4fd9-bd6b-75694b830f98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:35.215304 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63b39c-bf3c-4706-a242-a0c4d02212a2 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:35.221957 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d15350-bb55-4fd9-bd6b-75694b830f98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:35.223397 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d15350-bb55-4fd9-bd6b-75694b830f98 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:35.238217 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-35d15350-bb55-4fd9-bd6b-75694b830f98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:35.238217 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:35.238217 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:35.238217 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:35.238217 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:35.238217 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:35.238217 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:35.238217 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:35.238217 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:35.238217 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:35.238217 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:35.238217 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:35.238217 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:35.238217 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:35.238217 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:35.238217 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:35.239795 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:35.239795 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:35.239795 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:35.239795 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:35.239795 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:35.239795 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:35.239795 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:35.239795 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:35.239795 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:35.239795 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:35.239795 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:35.239795 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:35.239795 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:35.239795 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:35.239795 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:35.239795 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:35.239795 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:35.240871 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:35.240871 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:35.240871 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:35.240871 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 272/559] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:35.240871 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d15350-bb55-4fd9-bd6b-75694b830f98 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:35.255127 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa915a-72bb-4e30-9317-8ec348c44edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:35.255729 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa915a-72bb-4e30-9317-8ec348c44edc None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:35.256006 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa915a-72bb-4e30-9317-8ec348c44edc None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:35.256282 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa915a-72bb-4e30-9317-8ec348c44edc None admin] PATH_INFO: `/v3/domains` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:35.256945 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa915a-72bb-4e30-9317-8ec348c44edc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:35.257245 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa915a-72bb-4e30-9317-8ec348c44edc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:35.258605 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa915a-72bb-4e30-9317-8ec348c44edc None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:35.270142 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 288/560] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:35.270901 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa915a-72bb-4e30-9317-8ec348c44edc None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:35.341658 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d15350-bb55-4fd9-bd6b-75694b830f98 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:35.361661 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:35.370824 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa915a-72bb-4e30-9317-8ec348c44edc None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:35.375209 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebeada-7069-426c-9dea-a5f950c1af88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:35.375836 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebeada-7069-426c-9dea-a5f950c1af88 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:35.376115 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebeada-7069-426c-9dea-a5f950c1af88 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:35.376392 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebeada-7069-426c-9dea-a5f950c1af88 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:35.383742 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebeada-7069-426c-9dea-a5f950c1af88 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:35.385223 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebeada-7069-426c-9dea-a5f950c1af88 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:35.396882 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-7cebeada-7069-426c-9dea-a5f950c1af88 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 03:51:35.396882 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:35.396882 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:35.396882 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:35.396882 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:35.396882 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:35.396882 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:35.396882 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:35.396882 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:35.396882 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:35.396882 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:35.396882 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:35.396882 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 03:51:35.396882 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 03:51:35.396882 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 03:51:35.396882 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 03:51:35.397879 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:35.397879 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:35.397879 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 03:51:35.397879 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:35.397879 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 03:51:35.397879 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:35.397879 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:35.397879 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:35.397879 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:35.397879 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:35.397879 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:35.397879 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:35.397879 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:35.397879 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:35.397879 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:35.397879 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:35.397879 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:35.397879 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:35.398838 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:35.398838 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:35.398838 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 03:51:35.398838 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 03:51:35.398838 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 03:51:35.398838 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 03:51:35.398838 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 03:51:35.398838 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 03:51:35.398838 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 03:51:35.398838 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:35.398838 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 273/561] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:51:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:35.398838 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebeada-7069-426c-9dea-a5f950c1af88 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:35.409792 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cf26f-94bf-4510-9416-02ed5d2f5611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:35.410442 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cf26f-94bf-4510-9416-02ed5d2f5611 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:35.410723 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cf26f-94bf-4510-9416-02ed5d2f5611 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:35.411000 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cf26f-94bf-4510-9416-02ed5d2f5611 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:35.421682 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0cf26f-94bf-4510-9416-02ed5d2f5611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:35.423172 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0cf26f-94bf-4510-9416-02ed5d2f5611 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:35.425506 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:35.436935 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-9f0cf26f-94bf-4510-9416-02ed5d2f5611 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:35.436935 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:35.436935 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:35.436935 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:35.436935 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:35.436935 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:35.436935 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:35.436935 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:35.436935 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:35.436935 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:35.436935 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:35.436935 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:35.436935 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:35.436935 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:35.436935 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:35.436935 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:35.437899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:35.437899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:35.437899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:35.437899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:35.437899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:35.437899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:35.437899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:35.437899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:35.437899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:35.437899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:35.437899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:35.437899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:35.437899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:35.437899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:35.437899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:35.437899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:35.437899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:35.438917 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:35.438917 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:35.438917 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:35.438917 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 289/562] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:35.438917 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cf26f-94bf-4510-9416-02ed5d2f5611 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:35.501587 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebeada-7069-426c-9dea-a5f950c1af88 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:35.535608 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4302d6e-0b35-4439-99ef-d8f90716585d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:35.536202 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4302d6e-0b35-4439-99ef-d8f90716585d None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:35.536306 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cf26f-94bf-4510-9416-02ed5d2f5611 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:35.536515 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4302d6e-0b35-4439-99ef-d8f90716585d None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:35.536788 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4302d6e-0b35-4439-99ef-d8f90716585d None admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:35.537424 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4302d6e-0b35-4439-99ef-d8f90716585d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:35.537738 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4302d6e-0b35-4439-99ef-d8f90716585d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:35.539103 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4302d6e-0b35-4439-99ef-d8f90716585d None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:35.551173 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 274/563] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:35.551964 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4302d6e-0b35-4439-99ef-d8f90716585d None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:35.572665 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a3c2e-5e46-4279-84c4-d0cc98c6e318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:35.573311 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a3c2e-5e46-4279-84c4-d0cc98c6e318 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:35.573587 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a3c2e-5e46-4279-84c4-d0cc98c6e318 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:35.573859 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a3c2e-5e46-4279-84c4-d0cc98c6e318 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:35.580770 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a3c2e-5e46-4279-84c4-d0cc98c6e318 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:35.582210 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a3c2e-5e46-4279-84c4-d0cc98c6e318 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:35.594328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-fb8a3c2e-5e46-4279-84c4-d0cc98c6e318 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:35.594328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:35.594328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:35.594328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:35.594328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:35.594328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:35.594328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:35.594328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:35.594328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:35.594328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:35.594328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:35.594328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:35.594328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 03:51:35.594328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 03:51:35.594328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 03:51:35.595237 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 03:51:35.595237 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:35.595237 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:35.595237 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:35.595237 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:35.595237 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:35.595237 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:35.595237 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:35.595237 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:35.595237 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:35.595237 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:35.595237 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:35.595237 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:35.595237 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:35.595237 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:35.595237 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:35.595237 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:35.596159 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 03:51:35.596159 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 03:51:35.596159 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 03:51:35.596159 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 03:51:35.596159 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 03:51:35.596159 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 03:51:35.596159 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:35.596159 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:35.596159 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 290/564] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:51:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:35.596159 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a3c2e-5e46-4279-84c4-d0cc98c6e318 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:35.601101 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:35.641185 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:35.656418 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4302d6e-0b35-4439-99ef-d8f90716585d None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:35.689894 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03365c0-2afa-4be7-a227-d5154cf850b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:35.690482 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03365c0-2afa-4be7-a227-d5154cf850b1 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:35.690758 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03365c0-2afa-4be7-a227-d5154cf850b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:35.691027 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03365c0-2afa-4be7-a227-d5154cf850b1 None admin] PATH_INFO: `/v3/users` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:35.691732 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03365c0-2afa-4be7-a227-d5154cf850b1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:35.692031 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03365c0-2afa-4be7-a227-d5154cf850b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:35.693494 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03365c0-2afa-4be7-a227-d5154cf850b1 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:35.694927 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a3c2e-5e46-4279-84c4-d0cc98c6e318 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:35.710476 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 275/565] 10.222.0.43 () {56 vars in 1137 bytes} [Fri Aug 19 03:51:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:35.711331 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03365c0-2afa-4be7-a227-d5154cf850b1 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:35.731896 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2d3a3-8474-4644-a2b2-b2f2c12e3b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:35.732542 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2d3a3-8474-4644-a2b2-b2f2c12e3b29 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:35.732817 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2d3a3-8474-4644-a2b2-b2f2c12e3b29 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:35.733095 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2d3a3-8474-4644-a2b2-b2f2c12e3b29 None admin] PATH_INFO: `/v3/domains` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:35.733726 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2d3a3-8474-4644-a2b2-b2f2c12e3b29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:35.734037 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2d3a3-8474-4644-a2b2-b2f2c12e3b29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:35.735415 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2d3a3-8474-4644-a2b2-b2f2c12e3b29 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:35.747088 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 291/566] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:35.747873 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2d3a3-8474-4644-a2b2-b2f2c12e3b29 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:35.810790 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:35.810967 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03365c0-2afa-4be7-a227-d5154cf850b1 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:35.845409 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0ea4d-efc2-4af1-8d03-a3afeeae616d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:35.845964 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0ea4d-efc2-4af1-8d03-a3afeeae616d None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:35.846237 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0ea4d-efc2-4af1-8d03-a3afeeae616d None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:35.846509 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0ea4d-efc2-4af1-8d03-a3afeeae616d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:35.848658 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2d3a3-8474-4644-a2b2-b2f2c12e3b29 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:35.853369 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0ea4d-efc2-4af1-8d03-a3afeeae616d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:35.854804 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0ea4d-efc2-4af1-8d03-a3afeeae616d None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:35.866062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-08d0ea4d-efc2-4af1-8d03-a3afeeae616d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 03:51:35.866062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:35.866062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:35.866062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:35.866062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:35.866062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:35.866062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:35.866062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:35.866062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:35.866062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:35.866062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:35.866062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:35.866062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 03:51:35.866062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 03:51:35.866062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 03:51:35.866062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 03:51:35.867129 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:35.867129 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:35.867129 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 03:51:35.867129 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:35.867129 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 03:51:35.867129 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:35.867129 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:35.867129 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:35.867129 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:35.867129 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:35.867129 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:35.867129 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:35.867129 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:35.867129 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:35.867129 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:35.867129 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:35.867129 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:35.867129 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:35.868368 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:35.868368 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:35.868368 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 03:51:35.868368 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 03:51:35.868368 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 03:51:35.868368 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 03:51:35.868368 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 03:51:35.868368 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 03:51:35.868368 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 03:51:35.868368 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:35.868368 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 276/567] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 03:51:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:35.868368 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0ea4d-efc2-4af1-8d03-a3afeeae616d None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:35.873355 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:35.886792 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d5a07-c3e4-4a58-9062-70fb20192009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:35.887401 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d5a07-c3e4-4a58-9062-70fb20192009 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:35.887680 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d5a07-c3e4-4a58-9062-70fb20192009 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:35.887990 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d5a07-c3e4-4a58-9062-70fb20192009 None admin] PATH_INFO: `/v3/projects` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:35.888704 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d5a07-c3e4-4a58-9062-70fb20192009 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:35.889010 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d5a07-c3e4-4a58-9062-70fb20192009 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:35.890507 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d5a07-c3e4-4a58-9062-70fb20192009 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:35.902877 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 292/568] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 03:51:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:35.903656 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d5a07-c3e4-4a58-9062-70fb20192009 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:35.973306 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0ea4d-efc2-4af1-8d03-a3afeeae616d None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:36.002230 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d5a07-c3e4-4a58-9062-70fb20192009 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:36.006571 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea724dc9-76f0-4a0a-882f-2d11baa60e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:36.007184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea724dc9-76f0-4a0a-882f-2d11baa60e4c None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:36.007456 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea724dc9-76f0-4a0a-882f-2d11baa60e4c None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:36.007728 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea724dc9-76f0-4a0a-882f-2d11baa60e4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:36.018132 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea724dc9-76f0-4a0a-882f-2d11baa60e4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:36.019569 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea724dc9-76f0-4a0a-882f-2d11baa60e4c None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:36.024935 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:36.034046 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-ea724dc9-76f0-4a0a-882f-2d11baa60e4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:36.034046 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:36.034046 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:36.034046 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:36.034046 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:36.034046 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:36.034046 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:36.034046 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:36.034046 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:36.034046 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:36.034046 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:36.034046 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:36.034046 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:36.034046 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:36.034046 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:36.034046 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:36.035008 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:36.035008 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:36.035008 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:36.035008 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:36.035008 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:36.035008 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:36.035008 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:36.035008 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:36.035008 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:36.035008 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:36.035008 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:36.035008 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:36.035008 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:36.035008 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:36.035008 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:36.035008 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:36.035008 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:36.035944 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:36.035944 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:36.035944 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:36.035944 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 277/569] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:36.036303 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea724dc9-76f0-4a0a-882f-2d11baa60e4c None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:36.041057 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52205f14-8979-44dd-b634-98d7568aab20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:36.041689 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52205f14-8979-44dd-b634-98d7568aab20 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:36.041970 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52205f14-8979-44dd-b634-98d7568aab20 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:36.042243 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52205f14-8979-44dd-b634-98d7568aab20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:36.049470 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52205f14-8979-44dd-b634-98d7568aab20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:36.050918 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52205f14-8979-44dd-b634-98d7568aab20 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:36.061942 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-52205f14-8979-44dd-b634-98d7568aab20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:36.061942 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:36.061942 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:36.061942 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:36.061942 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:36.061942 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:36.061942 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:36.061942 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:36.061942 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:36.061942 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:36.061942 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:36.061942 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:36.061942 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 03:51:36.061942 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 03:51:36.061942 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 03:51:36.063540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 03:51:36.063540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:36.063540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:36.063540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:36.063540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:36.063540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:36.063540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:36.063540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:36.063540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:36.063540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:36.063540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:36.063540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:36.063540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:36.063540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:36.063540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:36.063540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:36.063540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:36.064545 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 03:51:36.064545 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 03:51:36.064545 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 03:51:36.064545 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 03:51:36.064545 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 03:51:36.064545 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 03:51:36.064545 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:36.064545 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:36.064545 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 293/570] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:51:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:36.064545 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52205f14-8979-44dd-b634-98d7568aab20 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:36.099028 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:36.144547 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea724dc9-76f0-4a0a-882f-2d11baa60e4c None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:36.162184 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52205f14-8979-44dd-b634-98d7568aab20 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:36.181271 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebe296-7823-4f14-94c3-0714eb862845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:36.181956 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebe296-7823-4f14-94c3-0714eb862845 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:36.182241 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebe296-7823-4f14-94c3-0714eb862845 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:36.182516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebe296-7823-4f14-94c3-0714eb862845 None admin] PATH_INFO: `/v3/users` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:36.183234 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebe296-7823-4f14-94c3-0714eb862845 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:36.183540 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebe296-7823-4f14-94c3-0714eb862845 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:36.185023 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebe296-7823-4f14-94c3-0714eb862845 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:36.195617 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418211a-ed7c-4515-a091-346a19425f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:36.196276 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418211a-ed7c-4515-a091-346a19425f3f None admin] REQUEST_METHOD: `PUT` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:36.196608 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418211a-ed7c-4515-a091-346a19425f3f None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:36.196889 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418211a-ed7c-4515-a091-346a19425f3f None admin] PATH_INFO: `/v3/projects/b09192159c884e73bef832a38e2d5e7c/users/7aab3a88f9d0401db32fbaadef2711ee/roles/ad0744b06a1644a5bbbe3f145f6ac4e0` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:36.203230 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 278/571] 10.222.0.43 () {56 vars in 1139 bytes} [Fri Aug 19 03:51:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:36.204037 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebe296-7823-4f14-94c3-0714eb862845 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:36.215707 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418211a-ed7c-4515-a091-346a19425f3f None admin] RBAC: Authorizing `identity:create_grant(project_id=b09192159c884e73bef832a38e2d5e7c, user_id=7aab3a88f9d0401db32fbaadef2711ee, role_id=ad0744b06a1644a5bbbe3f145f6ac4e0)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:36.217223 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418211a-ed7c-4515-a091-346a19425f3f None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:36.229056 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 294/572] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 03:51:36 2022] PUT /identity/v3/projects/b09192159c884e73bef832a38e2d5e7c/users/7aab3a88f9d0401db32fbaadef2711ee/roles/ad0744b06a1644a5bbbe3f145f6ac4e0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 03:51:36.229839 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418211a-ed7c-4515-a091-346a19425f3f None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:36.274498 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:36.315439 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebe296-7823-4f14-94c3-0714eb862845 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:36.331517 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:36.356831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04075349-9256-4515-8684-fcaf8acb5dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:36.357362 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04075349-9256-4515-8684-fcaf8acb5dcd None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:36.357640 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04075349-9256-4515-8684-fcaf8acb5dcd None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:36.357912 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04075349-9256-4515-8684-fcaf8acb5dcd None admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:36.358633 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04075349-9256-4515-8684-fcaf8acb5dcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:36.358872 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04075349-9256-4515-8684-fcaf8acb5dcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:36.360902 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04075349-9256-4515-8684-fcaf8acb5dcd None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:36.362173 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418211a-ed7c-4515-a091-346a19425f3f None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:36.374165 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 279/573] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:36.375384 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04075349-9256-4515-8684-fcaf8acb5dcd None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:36.408997 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b72482-4f29-4288-a360-8e3fa36be2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:36.409610 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b72482-4f29-4288-a360-8e3fa36be2ca None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:36.409890 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b72482-4f29-4288-a360-8e3fa36be2ca None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:36.410165 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b72482-4f29-4288-a360-8e3fa36be2ca None admin] PATH_INFO: `/v3/projects` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:36.410856 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b72482-4f29-4288-a360-8e3fa36be2ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:36.411162 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b72482-4f29-4288-a360-8e3fa36be2ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:36.412667 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b72482-4f29-4288-a360-8e3fa36be2ca None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:36.427513 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 295/574] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 03:51:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:36.428343 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b72482-4f29-4288-a360-8e3fa36be2ca None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:36.491656 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04075349-9256-4515-8684-fcaf8acb5dcd None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:36.521371 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:36.528659 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b72482-4f29-4288-a360-8e3fa36be2ca None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:36.529170 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460157f9-70c7-44eb-9cf1-62bcb3e78551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:36.529801 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460157f9-70c7-44eb-9cf1-62bcb3e78551 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:36.530201 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460157f9-70c7-44eb-9cf1-62bcb3e78551 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:36.530477 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460157f9-70c7-44eb-9cf1-62bcb3e78551 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:36.542451 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460157f9-70c7-44eb-9cf1-62bcb3e78551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:36.544027 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460157f9-70c7-44eb-9cf1-62bcb3e78551 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:36.559878 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-460157f9-70c7-44eb-9cf1-62bcb3e78551 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:36.559878 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:36.559878 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:36.559878 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:36.559878 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:36.559878 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:36.559878 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:36.559878 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:36.559878 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:36.559878 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:36.559878 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:36.559878 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:36.559878 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:36.559878 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:36.559878 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:36.559878 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:36.560903 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:36.560903 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:36.560903 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:36.560903 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:36.560903 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:36.560903 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:36.560903 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:36.560903 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:36.560903 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:36.560903 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:36.560903 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:36.560903 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:36.560903 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:36.560903 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:36.560903 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:36.560903 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:36.560903 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:36.561826 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:36.561826 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:36.561826 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:36.561826 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 280/575] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:36.561826 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460157f9-70c7-44eb-9cf1-62bcb3e78551 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:36.567523 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4319e-1e7f-4989-873b-628dbc30394e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:36.568162 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4319e-1e7f-4989-873b-628dbc30394e None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:36.568440 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4319e-1e7f-4989-873b-628dbc30394e None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:36.568843 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4319e-1e7f-4989-873b-628dbc30394e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:36.575986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4319e-1e7f-4989-873b-628dbc30394e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:36.577490 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4319e-1e7f-4989-873b-628dbc30394e None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:36.588926 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-9ae4319e-1e7f-4989-873b-628dbc30394e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:36.588926 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:36.588926 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:36.588926 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:36.588926 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:36.588926 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:36.588926 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:36.588926 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:36.588926 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:36.588926 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:36.588926 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:36.588926 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:36.588926 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 03:51:36.588926 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 03:51:36.588926 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 03:51:36.589857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 03:51:36.589857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:36.589857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:36.589857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:36.589857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:36.589857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:36.589857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:36.589857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:36.589857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:36.589857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:36.589857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:36.589857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:36.589857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:36.589857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:36.589857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:36.589857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:36.589857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:36.590758 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 03:51:36.590758 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 03:51:36.590758 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 03:51:36.590758 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 03:51:36.590758 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 03:51:36.590758 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 03:51:36.590758 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:36.590758 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:36.590758 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 296/576] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:51:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:36.590758 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4319e-1e7f-4989-873b-628dbc30394e None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:36.596189 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:36.671619 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460157f9-70c7-44eb-9cf1-62bcb3e78551 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:36.703234 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4319e-1e7f-4989-873b-628dbc30394e None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:36.706471 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9cb3d-f2ab-4a13-b11e-aef90dd76a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:36.707336 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9cb3d-f2ab-4a13-b11e-aef90dd76a0c None admin] REQUEST_METHOD: `PUT` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:36.707825 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9cb3d-f2ab-4a13-b11e-aef90dd76a0c None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:36.708317 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9cb3d-f2ab-4a13-b11e-aef90dd76a0c None admin] PATH_INFO: `/v3/projects/b09192159c884e73bef832a38e2d5e7c/users/6e8bf3b9cdd9431398a088815a44c8bb/roles/ad0744b06a1644a5bbbe3f145f6ac4e0` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:36.724591 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b9cb3d-f2ab-4a13-b11e-aef90dd76a0c None admin] RBAC: Authorizing `identity:create_grant(project_id=b09192159c884e73bef832a38e2d5e7c, user_id=6e8bf3b9cdd9431398a088815a44c8bb, role_id=ad0744b06a1644a5bbbe3f145f6ac4e0)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:36.726025 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b9cb3d-f2ab-4a13-b11e-aef90dd76a0c None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:36.739671 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 281/577] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 03:51:36 2022] PUT /identity/v3/projects/b09192159c884e73bef832a38e2d5e7c/users/6e8bf3b9cdd9431398a088815a44c8bb/roles/ad0744b06a1644a5bbbe3f145f6ac4e0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 03:51:36.740572 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9cb3d-f2ab-4a13-b11e-aef90dd76a0c None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:36.754207 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9ada3-24df-4f55-8c67-d526808b98cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:36.755702 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9ada3-24df-4f55-8c67-d526808b98cf None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:36.756515 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9ada3-24df-4f55-8c67-d526808b98cf None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:36.757001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9ada3-24df-4f55-8c67-d526808b98cf None admin] PATH_INFO: `/v3/domains` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:36.758180 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9ada3-24df-4f55-8c67-d526808b98cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:36.758701 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9ada3-24df-4f55-8c67-d526808b98cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:36.761253 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9ada3-24df-4f55-8c67-d526808b98cf None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:36.780637 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 297/578] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:36.787595 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9ada3-24df-4f55-8c67-d526808b98cf None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:36.809329 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:36.849908 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:36.884676 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9cb3d-f2ab-4a13-b11e-aef90dd76a0c None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:36.920590 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9ada3-24df-4f55-8c67-d526808b98cf None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:36.931571 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7caca1d-dc79-4c73-8de0-50aa03b1bc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:36.932103 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caca1d-dc79-4c73-8de0-50aa03b1bc5d None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:36.932375 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caca1d-dc79-4c73-8de0-50aa03b1bc5d None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:36.932674 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caca1d-dc79-4c73-8de0-50aa03b1bc5d None admin] PATH_INFO: `/v3/projects` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:36.933357 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7caca1d-dc79-4c73-8de0-50aa03b1bc5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:36.933652 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7caca1d-dc79-4c73-8de0-50aa03b1bc5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:36.935060 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7caca1d-dc79-4c73-8de0-50aa03b1bc5d None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:36.948412 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 282/579] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 03:51:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:36.954200 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7caca1d-dc79-4c73-8de0-50aa03b1bc5d None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:36.962581 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb28a9-3334-4824-9bb9-b2814049b5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:36.963632 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb28a9-3334-4824-9bb9-b2814049b5a7 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:36.963911 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb28a9-3334-4824-9bb9-b2814049b5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:36.964180 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb28a9-3334-4824-9bb9-b2814049b5a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:36.972775 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb28a9-3334-4824-9bb9-b2814049b5a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:36.974209 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb28a9-3334-4824-9bb9-b2814049b5a7 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:36.985866 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-addb28a9-3334-4824-9bb9-b2814049b5a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:36.985866 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:36.985866 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:36.985866 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:36.985866 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:36.985866 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:36.985866 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:36.985866 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:36.985866 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:36.985866 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:36.985866 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:36.985866 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:36.985866 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 03:51:36.985866 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 03:51:36.985866 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 03:51:36.987001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 03:51:36.987001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:36.987001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:36.987001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:36.987001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:36.987001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:36.987001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:36.987001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:36.987001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:36.987001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:36.987001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:36.987001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:36.987001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:36.987001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:36.987001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:36.987001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:36.987001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:36.988001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 03:51:36.988001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 03:51:36.988001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 03:51:36.988001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 03:51:36.988001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 03:51:36.988001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 03:51:36.988001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:36.988001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:36.988001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 298/580] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:51:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:36.999557 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb28a9-3334-4824-9bb9-b2814049b5a7 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:37.140702 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7caca1d-dc79-4c73-8de0-50aa03b1bc5d None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:37.144333 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:37.195133 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb28a9-3334-4824-9bb9-b2814049b5a7 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:37.213607 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e28abe-6202-44de-a77f-3df2ff0c4b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:37.214703 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e28abe-6202-44de-a77f-3df2ff0c4b87 None admin] REQUEST_METHOD: `PUT` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:37.215169 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e28abe-6202-44de-a77f-3df2ff0c4b87 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:37.215784 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e28abe-6202-44de-a77f-3df2ff0c4b87 None admin] PATH_INFO: `/v3/projects/b09192159c884e73bef832a38e2d5e7c/users/cfee7b193add48478b5240198b1aa602/roles/ad0744b06a1644a5bbbe3f145f6ac4e0` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:37.245944 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:37.255522 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e28abe-6202-44de-a77f-3df2ff0c4b87 None admin] RBAC: Authorizing `identity:create_grant(project_id=b09192159c884e73bef832a38e2d5e7c, user_id=cfee7b193add48478b5240198b1aa602, role_id=ad0744b06a1644a5bbbe3f145f6ac4e0)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:37.259293 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e28abe-6202-44de-a77f-3df2ff0c4b87 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:37.279164 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 283/581] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 03:51:36 2022] PUT /identity/v3/projects/b09192159c884e73bef832a38e2d5e7c/users/cfee7b193add48478b5240198b1aa602/roles/ad0744b06a1644a5bbbe3f145f6ac4e0 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 03:51:37.286309 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcf022-02bf-4072-9c0b-673a4454b806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:37.287675 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcf022-02bf-4072-9c0b-673a4454b806 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:37.288232 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcf022-02bf-4072-9c0b-673a4454b806 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:37.288802 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcf022-02bf-4072-9c0b-673a4454b806 None admin] PATH_INFO: `/v3/projects` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:37.289711 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebcf022-02bf-4072-9c0b-673a4454b806 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:37.290252 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebcf022-02bf-4072-9c0b-673a4454b806 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:37.292001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebcf022-02bf-4072-9c0b-673a4454b806 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:37.307531 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 299/582] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 03:51:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:37.314012 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e28abe-6202-44de-a77f-3df2ff0c4b87 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:37.425920 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e28abe-6202-44de-a77f-3df2ff0c4b87 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:37.461883 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58710da-5c29-42a4-ad54-ac86f2a16b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:37.462557 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58710da-5c29-42a4-ad54-ac86f2a16b7c None admin] REQUEST_METHOD: `PUT` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:37.462903 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58710da-5c29-42a4-ad54-ac86f2a16b7c None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:37.463305 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58710da-5c29-42a4-ad54-ac86f2a16b7c None admin] PATH_INFO: `/v3/projects/b09192159c884e73bef832a38e2d5e7c/users/00454605826e4d6593d2d6aa331ebdc6/roles/ad0744b06a1644a5bbbe3f145f6ac4e0` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:37.480784 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58710da-5c29-42a4-ad54-ac86f2a16b7c None admin] RBAC: Authorizing `identity:create_grant(project_id=b09192159c884e73bef832a38e2d5e7c, user_id=00454605826e4d6593d2d6aa331ebdc6, role_id=ad0744b06a1644a5bbbe3f145f6ac4e0)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:37.482336 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58710da-5c29-42a4-ad54-ac86f2a16b7c None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:37.499219 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 284/583] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 03:51:37 2022] PUT /identity/v3/projects/b09192159c884e73bef832a38e2d5e7c/users/00454605826e4d6593d2d6aa331ebdc6/roles/ad0744b06a1644a5bbbe3f145f6ac4e0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 03:51:38.463187 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773db55-0fa7-438b-a5d3-d6e55ab23275 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:38.463686 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773db55-0fa7-438b-a5d3-d6e55ab23275 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:38.463686 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773db55-0fa7-438b-a5d3-d6e55ab23275 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:38.465407 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 300/584] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:38.471654 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19e2a1-d660-4960-9985-22238c9eca1d None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:38.472128 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19e2a1-d660-4960-9985-22238c9eca1d None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:38.472229 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19e2a1-d660-4960-9985-22238c9eca1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:38.490057 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-1a19e2a1-d660-4960-9985-22238c9eca1d None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:38.491241 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-1a19e2a1-d660-4960-9985-22238c9eca1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:38.521011 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:38.562488 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 285/585] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:38.893012 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773db55-0fa7-438b-a5d3-d6e55ab23275 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:38.997666 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773db55-0fa7-438b-a5d3-d6e55ab23275 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:39.032787 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2000691-1684-4987-b7b5-1084d2aea35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:39.033423 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2000691-1684-4987-b7b5-1084d2aea35c None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:39.033703 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2000691-1684-4987-b7b5-1084d2aea35c None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:39.033978 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2000691-1684-4987-b7b5-1084d2aea35c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:39.035875 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:39.045109 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2000691-1684-4987-b7b5-1084d2aea35c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:39.050465 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-d2000691-1684-4987-b7b5-1084d2aea35c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:51:39.050465 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:39.050465 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:39.050465 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:39.050465 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:39.050465 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:39.050465 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:39.050465 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:39.050465 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:39.050465 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:39.050465 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:39.050465 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:39.050465 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:39.050465 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:39.050465 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:39.050465 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:39.051499 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:39.051499 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:39.051499 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:39.051499 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:39.051499 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:39.051499 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:39.051499 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:39.051499 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:39.051499 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:39.051499 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:39.051499 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:39.051499 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:39.051499 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:39.051499 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:39.051499 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:39.051499 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:39.052396 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:39.052396 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:39.052396 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:39.052396 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:39.052396 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:39.052396 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:39.052396 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:39.052396 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:39.052396 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:39.052396 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:39.052396 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:51:39.052396 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:39.052396 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 301/586] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 03:51:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:39.058064 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19e2a1-d660-4960-9985-22238c9eca1d None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:39.086888 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377f935-07cd-4b40-af80-765ec13d361d None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:39.086888 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377f935-07cd-4b40-af80-765ec13d361d None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:39.086888 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377f935-07cd-4b40-af80-765ec13d361d None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:39.087631 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 302/587] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 03:51:39.092939 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715722d-9256-4e75-991a-8d6db9672e32 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:39.093493 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715722d-9256-4e75-991a-8d6db9672e32 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:39.093980 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715722d-9256-4e75-991a-8d6db9672e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:39.113797 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-0715722d-9256-4e75-991a-8d6db9672e32 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:39.115371 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-0715722d-9256-4e75-991a-8d6db9672e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:39.178983 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19e2a1-d660-4960-9985-22238c9eca1d None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:39.196822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 303/588] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 03:51:39.215765 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7505fc-3cb1-4d78-9d89-f26ac560433f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:39.216373 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7505fc-3cb1-4d78-9d89-f26ac560433f None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:39.216682 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7505fc-3cb1-4d78-9d89-f26ac560433f None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:39.216954 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7505fc-3cb1-4d78-9d89-f26ac560433f None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:39.217615 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7505fc-3cb1-4d78-9d89-f26ac560433f None admin] RBAC: Adding query filter params (name=service) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:39.217953 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7505fc-3cb1-4d78-9d89-f26ac560433f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:39.219316 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7505fc-3cb1-4d78-9d89-f26ac560433f None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:39.228211 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 286/589] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 03:51:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:39.234003 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715722d-9256-4e75-991a-8d6db9672e32 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:39.344387 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715722d-9256-4e75-991a-8d6db9672e32 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:39.368652 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:39.381397 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93a9ed-cb6c-40a9-b22a-dce716b78e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:39.382366 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93a9ed-cb6c-40a9-b22a-dce716b78e1f None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:39.382861 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93a9ed-cb6c-40a9-b22a-dce716b78e1f None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:39.383345 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93a9ed-cb6c-40a9-b22a-dce716b78e1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:39.395013 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c93a9ed-cb6c-40a9-b22a-dce716b78e1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:39.396824 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c93a9ed-cb6c-40a9-b22a-dce716b78e1f None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:39.413344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-7c93a9ed-cb6c-40a9-b22a-dce716b78e1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:39.413344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:39.413344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:39.413344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:39.413344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:39.413344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:39.413344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:39.413344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:39.413344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:39.413344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:39.413344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:39.413344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:39.413344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:39.413344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:39.413344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:39.413344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:39.414416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:39.414416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:39.414416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:39.414416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:39.414416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:39.414416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:39.414416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:39.414416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:39.414416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:39.414416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:39.414416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:39.414416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:39.414416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:39.414416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:39.414416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:39.414416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:39.414416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:39.415345 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:39.415345 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:39.415345 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:39.417645 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 304/590] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:39.424403 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7505fc-3cb1-4d78-9d89-f26ac560433f None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:39.455545 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:39.536475 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7505fc-3cb1-4d78-9d89-f26ac560433f None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:39.559020 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93a9ed-cb6c-40a9-b22a-dce716b78e1f None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:39.579081 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c4e87-502f-4404-99ee-e6425f5d61f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:39.580173 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c4e87-502f-4404-99ee-e6425f5d61f0 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:39.580834 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c4e87-502f-4404-99ee-e6425f5d61f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:39.581118 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c4e87-502f-4404-99ee-e6425f5d61f0 None admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:39.581764 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c4e87-502f-4404-99ee-e6425f5d61f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:39.582070 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c4e87-502f-4404-99ee-e6425f5d61f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:39.583450 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c4e87-502f-4404-99ee-e6425f5d61f0 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:39.596648 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 287/591] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:39.597957 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131569e-2fc5-4d22-92bf-b04e7da34413 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:39.598238 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131569e-2fc5-4d22-92bf-b04e7da34413 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:39.598510 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131569e-2fc5-4d22-92bf-b04e7da34413 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:39.599996 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 288/592] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:39.601812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131569e-2fc5-4d22-92bf-b04e7da34413 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:39.674574 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93a9ed-cb6c-40a9-b22a-dce716b78e1f None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:39.701635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:39.709796 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ab943-e3f2-445a-91b0-e50e1906b1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:39.710422 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ab943-e3f2-445a-91b0-e50e1906b1cf None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:39.710699 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ab943-e3f2-445a-91b0-e50e1906b1cf None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:39.710962 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ab943-e3f2-445a-91b0-e50e1906b1cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:39.715148 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131569e-2fc5-4d22-92bf-b04e7da34413 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:39.722281 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ab943-e3f2-445a-91b0-e50e1906b1cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:39.727328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-e11ab943-e3f2-445a-91b0-e50e1906b1cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:51:39.727328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:39.727328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:39.727328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:39.727328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:39.727328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:39.727328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:39.727328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:39.727328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:39.727328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:39.727328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:39.727328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:39.727328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:39.727328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:39.727328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:39.727328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:39.728339 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:39.728339 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:39.728339 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:39.728339 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:39.728339 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:39.728339 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:39.728339 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:39.728339 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:39.728339 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:39.728339 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:39.728339 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:39.728339 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:39.728339 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:39.728339 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:39.728339 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:39.728339 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:39.734646 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:39.734646 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:39.734646 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:39.734646 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:39.734646 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:39.734646 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:39.734646 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:39.734646 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:39.734646 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:39.734646 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:39.734646 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:51:39.734646 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:39.734646 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 305/593] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 03:51:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 03:51:39.734646 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed03e3-0e6f-4867-9c10-ecde86ec9e19 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:39.735434 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed03e3-0e6f-4867-9c10-ecde86ec9e19 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:39.735434 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed03e3-0e6f-4867-9c10-ecde86ec9e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:39.750554 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-73ed03e3-0e6f-4867-9c10-ecde86ec9e19 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:39.751723 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-73ed03e3-0e6f-4867-9c10-ecde86ec9e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:39.752407 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9f1e2-dd52-4d1b-ba0b-3141415e0d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:39.753088 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9f1e2-dd52-4d1b-ba0b-3141415e0d0d None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:39.753370 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9f1e2-dd52-4d1b-ba0b-3141415e0d0d None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:39.753825 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9f1e2-dd52-4d1b-ba0b-3141415e0d0d None admin] PATH_INFO: `/v3/users/nova` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:39.763095 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9f1e2-dd52-4d1b-ba0b-3141415e0d0d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:39.765448 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9f1e2-dd52-4d1b-ba0b-3141415e0d0d None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:39.777242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-47c9f1e2-dd52-4d1b-ba0b-3141415e0d0d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 03:51:39.777242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:39.777242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:39.777242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:39.777242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:39.777242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:39.777242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:39.777242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:39.777242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:39.777242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:39.777242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:39.777242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:39.777242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 03:51:39.777242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 03:51:39.777242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 03:51:39.777242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 03:51:39.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:39.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:39.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 03:51:39.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:39.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 03:51:39.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:39.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:39.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:39.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:39.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:39.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:39.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:39.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:39.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:39.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:39.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:39.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:39.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:39.779175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:39.779175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:39.779175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 03:51:39.779175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 03:51:39.779175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 03:51:39.779175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 03:51:39.779175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 03:51:39.779175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 03:51:39.779175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 03:51:39.779175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:39.779175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 289/594] 10.222.0.43 () {56 vars in 1093 bytes} [Fri Aug 19 03:51:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 03:51:39.781413 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:39.784230 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9f1e2-dd52-4d1b-ba0b-3141415e0d0d None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:39.819665 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 306/595] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:39.820769 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354cc52-dc5b-4b9c-a156-8e339a8d091f None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:39.821062 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354cc52-dc5b-4b9c-a156-8e339a8d091f None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:39.821342 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354cc52-dc5b-4b9c-a156-8e339a8d091f None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:39.824988 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 307/596] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:39.824988 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354cc52-dc5b-4b9c-a156-8e339a8d091f None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:39.888670 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9f1e2-dd52-4d1b-ba0b-3141415e0d0d None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:39.926778 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c9b93-2cf6-4038-a523-21e1b6309d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:39.927587 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c9b93-2cf6-4038-a523-21e1b6309d7e None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:39.928037 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c9b93-2cf6-4038-a523-21e1b6309d7e None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:39.928559 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c9b93-2cf6-4038-a523-21e1b6309d7e None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:39.929369 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c9b93-2cf6-4038-a523-21e1b6309d7e None admin] RBAC: Adding query filter params (name=service) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:39.929676 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c9b93-2cf6-4038-a523-21e1b6309d7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:39.931034 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c9b93-2cf6-4038-a523-21e1b6309d7e None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:39.943501 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354cc52-dc5b-4b9c-a156-8e339a8d091f None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:39.943676 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 290/597] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 03:51:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:39.943676 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b149db8-8c51-4b73-ad1a-9396ee640558 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:39.943676 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b149db8-8c51-4b73-ad1a-9396ee640558 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:39.943676 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b149db8-8c51-4b73-ad1a-9396ee640558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:39.959356 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-0b149db8-8c51-4b73-ad1a-9396ee640558 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:39.960598 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-0b149db8-8c51-4b73-ad1a-9396ee640558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:39.963378 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:39.979546 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b82aa8-f40e-4951-b48e-9bbb65974855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:39.980152 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b82aa8-f40e-4951-b48e-9bbb65974855 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:39.980431 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b82aa8-f40e-4951-b48e-9bbb65974855 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:39.980750 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b82aa8-f40e-4951-b48e-9bbb65974855 None admin] PATH_INFO: `/v3/users` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:39.981470 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b82aa8-f40e-4951-b48e-9bbb65974855 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:39.981777 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b82aa8-f40e-4951-b48e-9bbb65974855 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:39.983215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b82aa8-f40e-4951-b48e-9bbb65974855 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:40.000517 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 308/598] 10.222.0.43 () {56 vars in 1133 bytes} [Fri Aug 19 03:51:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:40.000943 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b82aa8-f40e-4951-b48e-9bbb65974855 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:40.026993 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:40.038255 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 291/599] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:40.039279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b149db8-8c51-4b73-ad1a-9396ee640558 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:40.130475 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b82aa8-f40e-4951-b48e-9bbb65974855 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:40.152789 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b149db8-8c51-4b73-ad1a-9396ee640558 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:40.174243 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bdd5f-ac3a-4074-b382-11acc987362c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:40.175287 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bdd5f-ac3a-4074-b382-11acc987362c None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:40.175578 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bdd5f-ac3a-4074-b382-11acc987362c None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:40.175850 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bdd5f-ac3a-4074-b382-11acc987362c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:40.187776 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77bdd5f-ac3a-4074-b382-11acc987362c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:40.189311 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77bdd5f-ac3a-4074-b382-11acc987362c None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:40.189836 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576b715-753c-48d3-8857-2bb1cab3fdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:40.190431 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576b715-753c-48d3-8857-2bb1cab3fdfe None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:40.190706 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576b715-753c-48d3-8857-2bb1cab3fdfe None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:40.190974 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576b715-753c-48d3-8857-2bb1cab3fdfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:40.201700 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:40.207378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-b77bdd5f-ac3a-4074-b382-11acc987362c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:40.207378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:40.207378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:40.207378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:40.207378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:40.207378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:40.207378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:40.207378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:40.207378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:40.207378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:40.207378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:40.207378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:40.207378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:40.207378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:40.207378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:40.207378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:40.208343 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:40.208343 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:40.208343 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:40.208343 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:40.208343 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:40.208343 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:40.208343 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:40.208343 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:40.208343 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:40.208343 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:40.208343 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:40.208343 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:40.208343 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:40.208343 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:40.208343 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:40.208343 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:40.208343 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:40.209304 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:40.209304 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:40.209304 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:40.209304 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 309/600] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:40.213557 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bdd5f-ac3a-4074-b382-11acc987362c None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:40.267004 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576b715-753c-48d3-8857-2bb1cab3fdfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:40.268742 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576b715-753c-48d3-8857-2bb1cab3fdfe None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:40.296714 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:40.323936 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bdd5f-ac3a-4074-b382-11acc987362c None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:40.359658 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d6f20-d067-4b4a-a7bf-5c458618d929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:40.360278 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d6f20-d067-4b4a-a7bf-5c458618d929 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:40.360589 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d6f20-d067-4b4a-a7bf-5c458618d929 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:40.360866 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d6f20-d067-4b4a-a7bf-5c458618d929 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:40.371389 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d6f20-d067-4b4a-a7bf-5c458618d929 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:40.375696 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 292/601] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:51:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:51:40.376405 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576b715-753c-48d3-8857-2bb1cab3fdfe None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:40.377189 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-504d6f20-d067-4b4a-a7bf-5c458618d929 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:51:40.377189 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:40.377189 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:40.377189 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:40.377189 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:40.377189 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:40.377189 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:40.377189 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:40.377189 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:40.377189 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:40.377189 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:40.377189 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:40.377189 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:40.377189 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:40.377189 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:40.377189 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:40.378105 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:40.378105 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:40.378105 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:40.378105 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:40.378105 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:40.378105 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:40.378105 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:40.378105 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:40.378105 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:40.378105 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:40.378105 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:40.378105 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:40.378105 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:40.378105 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:40.378105 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:40.378105 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:40.382040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:40.382040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:40.382040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:40.382040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:40.382040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:40.382040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:40.382040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:40.382040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:40.382040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:40.382040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:40.382040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:51:40.382040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:40.382040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 310/602] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 03:51:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:40.382040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d6f20-d067-4b4a-a7bf-5c458618d929 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:40.418091 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:40.476688 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576b715-753c-48d3-8857-2bb1cab3fdfe None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:40.478894 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d6f20-d067-4b4a-a7bf-5c458618d929 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:40.510629 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2b9d9-c746-425f-a230-960013892470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:40.511244 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2b9d9-c746-425f-a230-960013892470 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:40.511518 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2b9d9-c746-425f-a230-960013892470 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:40.511787 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2b9d9-c746-425f-a230-960013892470 None admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:40.512411 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2b9d9-c746-425f-a230-960013892470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:40.512749 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2b9d9-c746-425f-a230-960013892470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:40.512930 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492700f-4906-425b-b141-59480d8b7db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:40.513377 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492700f-4906-425b-b141-59480d8b7db4 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:40.513653 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492700f-4906-425b-b141-59480d8b7db4 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:40.513924 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492700f-4906-425b-b141-59480d8b7db4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:40.514138 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2b9d9-c746-425f-a230-960013892470 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:40.517253 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:40.525610 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492700f-4906-425b-b141-59480d8b7db4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:40.526314 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 293/603] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:40.527093 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2b9d9-c746-425f-a230-960013892470 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:40.531209 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-0492700f-4906-425b-b141-59480d8b7db4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:51:40.531209 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:40.531209 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:40.531209 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:40.531209 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:40.531209 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:40.531209 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:40.531209 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:40.531209 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:40.531209 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:40.531209 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:40.531209 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:40.531209 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:40.531209 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:40.531209 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:40.531209 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:40.532227 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:40.532227 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:40.532227 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:40.532227 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:40.532227 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:40.532227 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:40.532227 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:40.532227 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:40.532227 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:40.532227 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:40.532227 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:40.532227 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:40.532227 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:40.532227 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:40.532227 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:40.532227 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:40.533503 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:40.533503 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:40.533503 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:40.533503 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:40.533503 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:40.533503 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:40.533503 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:40.533503 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:40.533503 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:40.533503 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:40.533503 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:51:40.533503 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:40.533503 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 311/604] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 03:51:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:40.533503 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492700f-4906-425b-b141-59480d8b7db4 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:40.626304 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:40.629494 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2b9d9-c746-425f-a230-960013892470 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:40.634673 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492700f-4906-425b-b141-59480d8b7db4 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:40.664697 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2351c-a71b-47a4-8a68-562a3687bec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:40.665313 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2351c-a71b-47a4-8a68-562a3687bec2 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:40.665593 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2351c-a71b-47a4-8a68-562a3687bec2 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:40.665887 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2351c-a71b-47a4-8a68-562a3687bec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:40.668019 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325409b-fb85-4410-a765-1f0f5fa7fe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:40.668649 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325409b-fb85-4410-a765-1f0f5fa7fe10 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:40.668931 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325409b-fb85-4410-a765-1f0f5fa7fe10 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:40.669209 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325409b-fb85-4410-a765-1f0f5fa7fe10 None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:40.669863 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325409b-fb85-4410-a765-1f0f5fa7fe10 None admin] RBAC: Adding query filter params (name=service) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:40.670166 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325409b-fb85-4410-a765-1f0f5fa7fe10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:40.671590 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325409b-fb85-4410-a765-1f0f5fa7fe10 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:40.676177 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2351c-a71b-47a4-8a68-562a3687bec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:40.677628 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2351c-a71b-47a4-8a68-562a3687bec2 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:40.679416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 312/605] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 03:51:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:40.680201 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325409b-fb85-4410-a765-1f0f5fa7fe10 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:40.691635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-62b2351c-a71b-47a4-8a68-562a3687bec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:40.691635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:40.691635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:40.691635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:40.691635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:40.691635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:40.691635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:40.691635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:40.691635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:40.691635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:40.691635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:40.691635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:40.691635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:40.691635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:40.691635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:40.691635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:40.692745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:40.692745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:40.692745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:40.692745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:40.692745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:40.692745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:40.692745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:40.692745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:40.692745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:40.692745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:40.692745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:40.692745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:40.692745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:40.692745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:40.692745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:40.692745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:40.692745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:40.693656 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:40.693656 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:40.693656 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:40.693656 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 294/606] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:40.693656 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2351c-a71b-47a4-8a68-562a3687bec2 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:40.741336 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:40.783311 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325409b-fb85-4410-a765-1f0f5fa7fe10 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:40.790096 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2351c-a71b-47a4-8a68-562a3687bec2 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:40.817488 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e62b6f-6200-498e-934b-384d0de68b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:40.818122 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e62b6f-6200-498e-934b-384d0de68b87 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:40.818399 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e62b6f-6200-498e-934b-384d0de68b87 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:40.818676 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e62b6f-6200-498e-934b-384d0de68b87 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:40.823064 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62bba1-ea4d-4aa1-9a82-1aa34182a5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:40.823655 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62bba1-ea4d-4aa1-9a82-1aa34182a5e0 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:40.823927 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62bba1-ea4d-4aa1-9a82-1aa34182a5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:40.824196 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62bba1-ea4d-4aa1-9a82-1aa34182a5e0 None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:40.824875 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62bba1-ea4d-4aa1-9a82-1aa34182a5e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:40.825172 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62bba1-ea4d-4aa1-9a82-1aa34182a5e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:40.826522 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62bba1-ea4d-4aa1-9a82-1aa34182a5e0 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:40.827525 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e62b6f-6200-498e-934b-384d0de68b87 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:40.829009 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e62b6f-6200-498e-934b-384d0de68b87 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:40.835089 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 295/607] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 03:51:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:40.835857 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62bba1-ea4d-4aa1-9a82-1aa34182a5e0 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:40.839887 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-11e62b6f-6200-498e-934b-384d0de68b87 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 03:51:40.839887 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:40.839887 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:40.839887 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:40.839887 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:40.839887 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:40.839887 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:40.839887 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:40.839887 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:40.839887 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:40.839887 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:40.839887 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:40.839887 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 03:51:40.839887 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 03:51:40.839887 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 03:51:40.839887 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 03:51:40.840991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:40.840991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:40.840991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 03:51:40.840991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:40.840991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 03:51:40.840991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:40.840991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:40.840991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:40.840991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:40.840991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:40.840991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:40.840991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:40.840991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:40.840991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:40.840991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:40.840991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:40.840991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:40.840991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:40.841972 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:40.841972 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:40.841972 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 03:51:40.841972 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 03:51:40.841972 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 03:51:40.841972 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 03:51:40.841972 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 03:51:40.841972 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 03:51:40.841972 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 03:51:40.841972 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:40.841972 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 313/608] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:51:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:40.841972 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e62b6f-6200-498e-934b-384d0de68b87 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:40.851777 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:40.934644 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62bba1-ea4d-4aa1-9a82-1aa34182a5e0 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:40.941999 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e62b6f-6200-498e-934b-384d0de68b87 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:40.958399 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:40.968554 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05200a-6907-4305-8ab2-20f5a7fdb6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:40.969177 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05200a-6907-4305-8ab2-20f5a7fdb6af None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:40.969456 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05200a-6907-4305-8ab2-20f5a7fdb6af None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:40.969737 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05200a-6907-4305-8ab2-20f5a7fdb6af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:40.975082 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeec9c6-ad57-4019-b033-e6838cbc0977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:40.975666 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeec9c6-ad57-4019-b033-e6838cbc0977 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:40.975940 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeec9c6-ad57-4019-b033-e6838cbc0977 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:40.976207 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeec9c6-ad57-4019-b033-e6838cbc0977 None admin] PATH_INFO: `/v3/domains` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:40.976872 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeec9c6-ad57-4019-b033-e6838cbc0977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:40.977167 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeec9c6-ad57-4019-b033-e6838cbc0977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:40.978541 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeec9c6-ad57-4019-b033-e6838cbc0977 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:40.980294 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05200a-6907-4305-8ab2-20f5a7fdb6af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:40.981768 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05200a-6907-4305-8ab2-20f5a7fdb6af None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:40.990257 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 314/609] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:40.991051 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeec9c6-ad57-4019-b033-e6838cbc0977 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:40.996774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-4f05200a-6907-4305-8ab2-20f5a7fdb6af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:40.996774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:40.996774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:40.996774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:40.996774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:40.996774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:40.996774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:40.996774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:40.996774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:40.996774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:40.996774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:40.996774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:40.996774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:40.996774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:40.996774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:40.996774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:40.997851 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:40.997851 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:40.997851 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:40.997851 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:40.997851 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:40.997851 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:40.997851 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:40.997851 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:40.997851 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:40.997851 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:40.997851 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:40.997851 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:40.997851 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:40.997851 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:40.997851 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:40.997851 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:40.997851 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:40.999315 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:40.999315 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:40.999315 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:40.999315 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 296/610] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:40.999315 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05200a-6907-4305-8ab2-20f5a7fdb6af None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:41.064032 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:41.090390 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeec9c6-ad57-4019-b033-e6838cbc0977 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:41.098693 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05200a-6907-4305-8ab2-20f5a7fdb6af None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:41.122828 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f9112-bae6-4d17-9ac6-4e80818e64ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:41.123452 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f9112-bae6-4d17-9ac6-4e80818e64ef None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:41.124253 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f9112-bae6-4d17-9ac6-4e80818e64ef None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:41.124569 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f9112-bae6-4d17-9ac6-4e80818e64ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:41.131868 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0098d-2893-45bd-845c-ba6e65ad2298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:41.132495 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0098d-2893-45bd-845c-ba6e65ad2298 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:41.132777 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0098d-2893-45bd-845c-ba6e65ad2298 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:41.133053 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0098d-2893-45bd-845c-ba6e65ad2298 None admin] PATH_INFO: `/v3/users` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:41.133772 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d0098d-2893-45bd-845c-ba6e65ad2298 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:41.134076 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d0098d-2893-45bd-845c-ba6e65ad2298 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:41.134172 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f9112-bae6-4d17-9ac6-4e80818e64ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:41.135514 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d0098d-2893-45bd-845c-ba6e65ad2298 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:41.135628 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f9112-bae6-4d17-9ac6-4e80818e64ef None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:41.150253 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-a63f9112-bae6-4d17-9ac6-4e80818e64ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:41.150253 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:41.150253 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:41.150253 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:41.150253 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:41.150253 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:41.150253 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:41.150253 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:41.150253 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:41.150253 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:41.150253 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:41.150253 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:41.150253 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:41.150253 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:41.150253 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:41.150253 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:41.151198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:41.151198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:41.151198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:41.151198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:41.151198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:41.151198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:41.151198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:41.151198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:41.151198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:41.151198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:41.151198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:41.151198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:41.151198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:41.151198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:41.151198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:41.151198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:41.151198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:41.152097 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:41.152097 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:41.152097 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:41.152097 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 315/611] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:41.152323 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f9112-bae6-4d17-9ac6-4e80818e64ef None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:41.160797 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 297/612] 10.222.0.43 () {56 vars in 1137 bytes} [Fri Aug 19 03:51:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:41.160797 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0098d-2893-45bd-845c-ba6e65ad2298 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:41.190762 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:41.258213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0098d-2893-45bd-845c-ba6e65ad2298 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:41.263174 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f9112-bae6-4d17-9ac6-4e80818e64ef None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:41.281790 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:41.293582 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798a62d-ce71-414e-a117-68615e409445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:41.294177 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798a62d-ce71-414e-a117-68615e409445 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:41.294451 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798a62d-ce71-414e-a117-68615e409445 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:41.294722 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798a62d-ce71-414e-a117-68615e409445 None admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:41.295351 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798a62d-ce71-414e-a117-68615e409445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:41.296179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798a62d-ce71-414e-a117-68615e409445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:41.297616 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798a62d-ce71-414e-a117-68615e409445 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:41.299868 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0fb8c-0952-4791-900e-c1a08b9cd936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:41.300506 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0fb8c-0952-4791-900e-c1a08b9cd936 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:41.300795 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0fb8c-0952-4791-900e-c1a08b9cd936 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:41.301068 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0fb8c-0952-4791-900e-c1a08b9cd936 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:41.307871 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0fb8c-0952-4791-900e-c1a08b9cd936 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:41.309013 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 298/613] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:41.309368 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0fb8c-0952-4791-900e-c1a08b9cd936 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:41.309790 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798a62d-ce71-414e-a117-68615e409445 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:41.323185 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-46f0fb8c-0952-4791-900e-c1a08b9cd936 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:41.323185 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:41.323185 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:41.323185 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:41.323185 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:41.323185 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:41.323185 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:41.323185 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:41.323185 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:41.323185 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:41.323185 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:41.323185 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:41.323185 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 03:51:41.323185 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 03:51:41.323185 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 03:51:41.324272 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 03:51:41.324272 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:41.324272 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:41.324272 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:41.324272 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:41.324272 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:41.324272 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:41.324272 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:41.324272 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:41.324272 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:41.324272 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:41.324272 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:41.324272 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:41.324272 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:41.324272 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:41.324272 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:41.324272 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:41.325243 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 03:51:41.325243 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 03:51:41.325243 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 03:51:41.325243 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 03:51:41.325243 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 03:51:41.325243 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 03:51:41.325243 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:41.325243 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:41.325243 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 316/614] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:51:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:41.325747 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0fb8c-0952-4791-900e-c1a08b9cd936 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:41.409193 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798a62d-ce71-414e-a117-68615e409445 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:41.411686 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:41.422642 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0fb8c-0952-4791-900e-c1a08b9cd936 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:41.443738 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb858509-f1c9-489a-b9a5-cc38246fa8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:41.444434 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb858509-f1c9-489a-b9a5-cc38246fa8f7 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:41.444808 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb858509-f1c9-489a-b9a5-cc38246fa8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:41.445155 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb858509-f1c9-489a-b9a5-cc38246fa8f7 None admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:41.445856 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb858509-f1c9-489a-b9a5-cc38246fa8f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:41.446229 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb858509-f1c9-489a-b9a5-cc38246fa8f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:41.447666 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb858509-f1c9-489a-b9a5-cc38246fa8f7 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:41.455185 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b63455-ad35-49ce-ad35-d6a0eedf67a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:41.455868 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b63455-ad35-49ce-ad35-d6a0eedf67a6 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:41.456217 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b63455-ad35-49ce-ad35-d6a0eedf67a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:41.456504 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b63455-ad35-49ce-ad35-d6a0eedf67a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:41.459427 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 299/615] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:41.460410 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb858509-f1c9-489a-b9a5-cc38246fa8f7 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:41.505925 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:41.528188 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b63455-ad35-49ce-ad35-d6a0eedf67a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:41.529635 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b63455-ad35-49ce-ad35-d6a0eedf67a6 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:41.558731 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb858509-f1c9-489a-b9a5-cc38246fa8f7 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:41.591546 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb428859-7b80-446d-b35e-629726487cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:41.592163 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb428859-7b80-446d-b35e-629726487cc3 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:41.592513 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb428859-7b80-446d-b35e-629726487cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:41.592786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb428859-7b80-446d-b35e-629726487cc3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:41.600171 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb428859-7b80-446d-b35e-629726487cc3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:41.601618 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb428859-7b80-446d-b35e-629726487cc3 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:41.613364 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-cb428859-7b80-446d-b35e-629726487cc3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 03:51:41.613364 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:41.613364 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:41.613364 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:41.613364 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:41.613364 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:41.613364 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:41.613364 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:41.613364 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:41.613364 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:41.613364 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:41.613364 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:41.613364 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 03:51:41.613364 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 03:51:41.613364 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 03:51:41.613364 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 03:51:41.614486 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:41.614486 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:41.614486 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 03:51:41.614486 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:41.614486 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 03:51:41.614486 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:41.614486 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:41.614486 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:41.614486 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:41.614486 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:41.614486 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:41.614486 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:41.614486 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:41.614486 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:41.614486 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:41.614486 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:41.614486 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:41.614486 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:41.615675 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:41.615675 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:41.615675 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 03:51:41.615675 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 03:51:41.615675 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 03:51:41.615675 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 03:51:41.615675 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 03:51:41.615675 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 03:51:41.615675 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 03:51:41.615675 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:41.621202 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:41.621302 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 300/616] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:51:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:41.621302 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb428859-7b80-446d-b35e-629726487cc3 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:41.626914 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 317/617] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:51:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:51:41.627728 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b63455-ad35-49ce-ad35-d6a0eedf67a6 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:41.722652 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb428859-7b80-446d-b35e-629726487cc3 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:41.723164 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b63455-ad35-49ce-ad35-d6a0eedf67a6 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:41.724949 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:41.756339 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c8c11-74d5-4980-93a0-15a98729d037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:41.756952 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c8c11-74d5-4980-93a0-15a98729d037 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:41.757228 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c8c11-74d5-4980-93a0-15a98729d037 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:41.757346 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f7eae-5e53-4c07-bc78-368f51aeb860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:41.757497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c8c11-74d5-4980-93a0-15a98729d037 None admin] PATH_INFO: `/v3/projects` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:41.757968 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f7eae-5e53-4c07-bc78-368f51aeb860 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:41.758170 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c8c11-74d5-4980-93a0-15a98729d037 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:41.758272 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f7eae-5e53-4c07-bc78-368f51aeb860 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:41.758469 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c8c11-74d5-4980-93a0-15a98729d037 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:41.758562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f7eae-5e53-4c07-bc78-368f51aeb860 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:41.759895 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c8c11-74d5-4980-93a0-15a98729d037 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:41.765357 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f7eae-5e53-4c07-bc78-368f51aeb860 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:41.767044 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f7eae-5e53-4c07-bc78-368f51aeb860 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:41.771698 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 301/618] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 03:51:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:41.772465 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c8c11-74d5-4980-93a0-15a98729d037 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:41.778388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-9c0f7eae-5e53-4c07-bc78-368f51aeb860 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 03:51:41.778388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:41.778388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:41.778388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:41.778388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:41.778388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:41.778388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:41.778388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:41.778388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:41.778388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:41.778388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:41.778388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:41.778388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 03:51:41.778388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 03:51:41.778388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 03:51:41.778388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 03:51:41.784636 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:41.784636 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:41.784636 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 03:51:41.784636 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:41.784636 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 03:51:41.784636 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:41.784636 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:41.784636 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:41.784636 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:41.784636 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:41.784636 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:41.784636 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:41.784636 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:41.784636 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:41.784636 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:41.784636 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:41.784636 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:41.784636 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:41.785821 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:41.785821 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:41.785821 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 03:51:41.785821 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 03:51:41.785821 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 03:51:41.785821 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 03:51:41.785821 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 03:51:41.785821 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 03:51:41.785821 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 03:51:41.785821 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:41.785821 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 318/619] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 03:51:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:41.785821 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f7eae-5e53-4c07-bc78-368f51aeb860 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:41.829005 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:41.879397 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c8c11-74d5-4980-93a0-15a98729d037 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:41.880512 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f7eae-5e53-4c07-bc78-368f51aeb860 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:41.912799 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fff258-278b-4a55-a6f1-25897b9924ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:41.913396 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fff258-278b-4a55-a6f1-25897b9924ab None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:41.913632 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127a0b2-e24a-4bc3-b564-23d0e210821f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:41.913742 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fff258-278b-4a55-a6f1-25897b9924ab None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:41.913927 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fff258-278b-4a55-a6f1-25897b9924ab None admin] PATH_INFO: `/v3/users` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:41.914246 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127a0b2-e24a-4bc3-b564-23d0e210821f None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:41.914545 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127a0b2-e24a-4bc3-b564-23d0e210821f None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:41.914642 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fff258-278b-4a55-a6f1-25897b9924ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:41.914814 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127a0b2-e24a-4bc3-b564-23d0e210821f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:41.914923 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fff258-278b-4a55-a6f1-25897b9924ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:41.916354 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fff258-278b-4a55-a6f1-25897b9924ab None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:41.925591 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127a0b2-e24a-4bc3-b564-23d0e210821f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:41.927091 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127a0b2-e24a-4bc3-b564-23d0e210821f None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:41.933452 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 302/620] 10.222.0.43 () {56 vars in 1137 bytes} [Fri Aug 19 03:51:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:41.934165 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fff258-278b-4a55-a6f1-25897b9924ab None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:41.944126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-f127a0b2-e24a-4bc3-b564-23d0e210821f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:41.944126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:41.944126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:41.944126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:41.944126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:41.944126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:41.944126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:41.944126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:41.944126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:41.944126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:41.944126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:41.944126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:41.944126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:41.944126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:41.944126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:41.944126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:41.945290 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:41.945290 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:41.945290 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:41.945290 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:41.945290 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:41.945290 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:41.945290 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:41.945290 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:41.945290 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:41.945290 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:41.945290 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:41.945290 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:41.945290 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:41.945290 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:41.945290 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:41.945290 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:41.945290 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:41.946349 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:41.946349 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:41.946349 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:41.946349 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 319/621] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:41.946349 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127a0b2-e24a-4bc3-b564-23d0e210821f None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:41.960807 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:42.041658 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fff258-278b-4a55-a6f1-25897b9924ab None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:42.044882 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127a0b2-e24a-4bc3-b564-23d0e210821f None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:42.046378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:42.074897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b4f47-0828-4d57-bc7b-6ffb0845fe2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:42.075490 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b4f47-0828-4d57-bc7b-6ffb0845fe2d None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:42.075764 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b4f47-0828-4d57-bc7b-6ffb0845fe2d None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:42.076031 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b4f47-0828-4d57-bc7b-6ffb0845fe2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:42.077360 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b4f47-0828-4d57-bc7b-6ffb0845fe2d None admin] RBAC: Adding query filter params (role.id=ad0744b06a1644a5bbbe3f145f6ac4e0, scope.project.id=b09192159c884e73bef832a38e2d5e7c, user.id=7aab3a88f9d0401db32fbaadef2711ee) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:42.077665 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b4f47-0828-4d57-bc7b-6ffb0845fe2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:42.078526 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64552a5c-141c-427e-86f7-6962d88500f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:42.079072 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b4f47-0828-4d57-bc7b-6ffb0845fe2d None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:42.079170 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64552a5c-141c-427e-86f7-6962d88500f9 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:42.079386 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64552a5c-141c-427e-86f7-6962d88500f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:42.079659 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64552a5c-141c-427e-86f7-6962d88500f9 None admin] PATH_INFO: `/v3/users` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:42.080394 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64552a5c-141c-427e-86f7-6962d88500f9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:42.080728 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64552a5c-141c-427e-86f7-6962d88500f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:42.082133 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64552a5c-141c-427e-86f7-6962d88500f9 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:42.084678 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 303/622] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:51:41 2022] GET /identity/v3/role_assignments?user.id=7aab3a88f9d0401db32fbaadef2711ee&scope.project.id=b09192159c884e73bef832a38e2d5e7c&role.id=ad0744b06a1644a5bbbe3f145f6ac4e0 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:42.085448 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b4f47-0828-4d57-bc7b-6ffb0845fe2d None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:42.100613 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 320/623] 10.222.0.43 () {56 vars in 1139 bytes} [Fri Aug 19 03:51:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:42.101550 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64552a5c-141c-427e-86f7-6962d88500f9 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:42.197481 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:42.215379 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64552a5c-141c-427e-86f7-6962d88500f9 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:42.216269 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b4f47-0828-4d57-bc7b-6ffb0845fe2d None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:42.256087 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0f0bc-bb03-432b-a976-1d8bef320309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:42.256714 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0f0bc-bb03-432b-a976-1d8bef320309 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:42.256992 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0f0bc-bb03-432b-a976-1d8bef320309 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:42.257272 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0f0bc-bb03-432b-a976-1d8bef320309 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:42.257980 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa714a-db30-40e4-9c79-f8823a30e536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:42.258682 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa714a-db30-40e4-9c79-f8823a30e536 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:42.259057 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa714a-db30-40e4-9c79-f8823a30e536 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:42.259444 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa714a-db30-40e4-9c79-f8823a30e536 None admin] PATH_INFO: `/v3/domains` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:42.260191 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa714a-db30-40e4-9c79-f8823a30e536 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:42.260626 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa714a-db30-40e4-9c79-f8823a30e536 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:42.262096 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa714a-db30-40e4-9c79-f8823a30e536 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:42.276209 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 321/624] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:42.277104 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa714a-db30-40e4-9c79-f8823a30e536 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:42.304901 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:42.340341 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0f0bc-bb03-432b-a976-1d8bef320309 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:42.341800 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0f0bc-bb03-432b-a976-1d8bef320309 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:42.395843 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa714a-db30-40e4-9c79-f8823a30e536 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:42.431688 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b51028-2477-4fe8-b63e-366ce3b9bf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:42.432118 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:42.432450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b51028-2477-4fe8-b63e-366ce3b9bf81 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:42.432760 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b51028-2477-4fe8-b63e-366ce3b9bf81 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:42.433200 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b51028-2477-4fe8-b63e-366ce3b9bf81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:42.450337 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 304/625] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:51:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:51:42.452261 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0f0bc-bb03-432b-a976-1d8bef320309 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:42.505409 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b51028-2477-4fe8-b63e-366ce3b9bf81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:42.506899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b51028-2477-4fe8-b63e-366ce3b9bf81 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:42.529428 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:42.554107 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0f0bc-bb03-432b-a976-1d8bef320309 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:42.588049 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6bbd4-4661-4486-b05e-7708f4888d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:42.588626 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6bbd4-4661-4486-b05e-7708f4888d2b None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:42.588905 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6bbd4-4661-4486-b05e-7708f4888d2b None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:42.589175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6bbd4-4661-4486-b05e-7708f4888d2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:42.595727 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6bbd4-4661-4486-b05e-7708f4888d2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:42.597193 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6bbd4-4661-4486-b05e-7708f4888d2b None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:42.612054 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-4aa6bbd4-4661-4486-b05e-7708f4888d2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:42.612054 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:42.612054 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:42.612054 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:42.612054 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:42.612054 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:42.612054 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:42.612054 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:42.612054 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:42.612054 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:42.612054 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:42.612054 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:42.612054 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 03:51:42.612054 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 03:51:42.612054 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 03:51:42.613260 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 03:51:42.613260 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:42.613260 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:42.613260 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:42.613260 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:42.613260 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:42.613260 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:42.613260 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:42.613260 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:42.613260 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:42.613260 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:42.613260 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:42.613260 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:42.613260 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:42.613260 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:42.613260 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:42.613260 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:42.614158 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 03:51:42.614158 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 03:51:42.614158 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 03:51:42.614158 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 03:51:42.614158 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 03:51:42.614158 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 03:51:42.614158 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:42.614158 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:42.614158 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 305/626] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:51:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:42.614158 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6bbd4-4661-4486-b05e-7708f4888d2b None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:42.626304 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 322/627] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:51:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:51:42.626304 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b51028-2477-4fe8-b63e-366ce3b9bf81 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:42.670802 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:42.728030 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6bbd4-4661-4486-b05e-7708f4888d2b None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:42.733286 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b51028-2477-4fe8-b63e-366ce3b9bf81 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:42.755918 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:42.765734 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4efd3b-669f-4329-b286-2726db69a6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:42.766354 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4efd3b-669f-4329-b286-2726db69a6a3 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:42.766628 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4efd3b-669f-4329-b286-2726db69a6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:42.767193 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4efd3b-669f-4329-b286-2726db69a6a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:42.771939 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06c69f-87bb-476c-916a-95e026d44428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:42.772557 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06c69f-87bb-476c-916a-95e026d44428 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:42.772835 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06c69f-87bb-476c-916a-95e026d44428 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:42.773106 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06c69f-87bb-476c-916a-95e026d44428 None admin] PATH_INFO: `/v3/projects` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:42.773781 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06c69f-87bb-476c-916a-95e026d44428 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:42.774081 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06c69f-87bb-476c-916a-95e026d44428 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:42.775499 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06c69f-87bb-476c-916a-95e026d44428 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:42.777884 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4efd3b-669f-4329-b286-2726db69a6a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:42.779363 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4efd3b-669f-4329-b286-2726db69a6a3 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:42.787360 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 323/628] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 03:51:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:42.788400 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06c69f-87bb-476c-916a-95e026d44428 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:42.800755 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-7b4efd3b-669f-4329-b286-2726db69a6a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:42.800755 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:42.800755 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:42.800755 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:42.800755 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:42.800755 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:42.800755 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:42.800755 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:42.800755 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:42.800755 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:42.800755 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:42.800755 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:42.800755 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:42.800755 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:42.800755 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:42.800755 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:42.801774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:42.801774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:42.801774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:42.801774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:42.801774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:42.801774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:42.801774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:42.801774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:42.801774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:42.801774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:42.801774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:42.801774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:42.801774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:42.801774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:42.801774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:42.801774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:42.801774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:42.803163 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:42.803163 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:42.803163 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:42.803163 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 306/629] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:42.803163 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4efd3b-669f-4329-b286-2726db69a6a3 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:42.897596 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06c69f-87bb-476c-916a-95e026d44428 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:42.907179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:42.911185 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4efd3b-669f-4329-b286-2726db69a6a3 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:42.933704 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf3aa2-1079-4c67-a882-605c2c04d4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:42.934324 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf3aa2-1079-4c67-a882-605c2c04d4a9 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:42.934600 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf3aa2-1079-4c67-a882-605c2c04d4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:42.934876 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf3aa2-1079-4c67-a882-605c2c04d4a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:42.945814 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf3aa2-1079-4c67-a882-605c2c04d4a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:42.947258 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf3aa2-1079-4c67-a882-605c2c04d4a9 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:42.947374 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1d66d-5a7a-4df1-8096-07b366e8cd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:42.947957 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1d66d-5a7a-4df1-8096-07b366e8cd1a None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:42.948236 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1d66d-5a7a-4df1-8096-07b366e8cd1a None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:42.948535 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1d66d-5a7a-4df1-8096-07b366e8cd1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:42.949252 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1d66d-5a7a-4df1-8096-07b366e8cd1a None admin] RBAC: Adding query filter params (role.id=ad0744b06a1644a5bbbe3f145f6ac4e0, scope.project.id=b09192159c884e73bef832a38e2d5e7c, user.id=6e8bf3b9cdd9431398a088815a44c8bb) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:42.949559 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1d66d-5a7a-4df1-8096-07b366e8cd1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:42.951013 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1d66d-5a7a-4df1-8096-07b366e8cd1a None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:42.961755 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-63cf3aa2-1079-4c67-a882-605c2c04d4a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:42.961755 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:42.961755 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:42.961755 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:42.961755 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:42.961755 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:42.961755 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:42.961755 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:42.961755 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:42.961755 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:42.961755 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:42.961755 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:42.961755 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:42.961755 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:42.961755 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:42.961755 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:42.962771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:42.962771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:42.962771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:42.962771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:42.962771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:42.962771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:42.962771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:42.962771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:42.962771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:42.962771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:42.962771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:42.962771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:42.962771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:42.962771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:42.962771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:42.962771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:42.962771 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:42.963700 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:42.963700 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:42.963700 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:42.964301 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 307/630] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:51:42 2022] GET /identity/v3/role_assignments?user.id=6e8bf3b9cdd9431398a088815a44c8bb&scope.project.id=b09192159c884e73bef832a38e2d5e7c&role.id=ad0744b06a1644a5bbbe3f145f6ac4e0 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:42.972921 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1d66d-5a7a-4df1-8096-07b366e8cd1a None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:42.973143 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 324/631] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:42.973837 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf3aa2-1079-4c67-a882-605c2c04d4a9 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:43.008031 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:43.089406 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf3aa2-1079-4c67-a882-605c2c04d4a9 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:43.092367 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1d66d-5a7a-4df1-8096-07b366e8cd1a None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:43.135175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e6f38-b506-4eda-b682-aaffcb98fdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:43.135661 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e6f38-b506-4eda-b682-aaffcb98fdc1 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:43.135944 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e6f38-b506-4eda-b682-aaffcb98fdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:43.136219 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e6f38-b506-4eda-b682-aaffcb98fdc1 None admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:43.136918 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e6f38-b506-4eda-b682-aaffcb98fdc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:43.137227 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e6f38-b506-4eda-b682-aaffcb98fdc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:43.138724 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e6f38-b506-4eda-b682-aaffcb98fdc1 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:43.142690 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5d2af-4f4d-4dac-8389-adad1a88bce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:43.143573 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5d2af-4f4d-4dac-8389-adad1a88bce6 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:43.144021 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5d2af-4f4d-4dac-8389-adad1a88bce6 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:43.144458 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5d2af-4f4d-4dac-8389-adad1a88bce6 None admin] PATH_INFO: `/v3/domains` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:43.145285 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5d2af-4f4d-4dac-8389-adad1a88bce6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:43.145591 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5d2af-4f4d-4dac-8389-adad1a88bce6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:43.146999 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5d2af-4f4d-4dac-8389-adad1a88bce6 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:43.153969 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 308/632] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:43.159570 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e6f38-b506-4eda-b682-aaffcb98fdc1 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:43.167306 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 325/633] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:43.173431 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5d2af-4f4d-4dac-8389-adad1a88bce6 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:43.199925 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:43.288515 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:43.297209 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e6f38-b506-4eda-b682-aaffcb98fdc1 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:43.297921 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5d2af-4f4d-4dac-8389-adad1a88bce6 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:43.332915 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c05450-571e-4455-8bab-886586d6a1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:43.333677 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c05450-571e-4455-8bab-886586d6a1a4 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:43.334024 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c05450-571e-4455-8bab-886586d6a1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:43.334369 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c05450-571e-4455-8bab-886586d6a1a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:43.338731 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa4f59-fc32-437d-a31b-027859234183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:43.339361 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa4f59-fc32-437d-a31b-027859234183 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:43.339639 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa4f59-fc32-437d-a31b-027859234183 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:43.339911 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa4f59-fc32-437d-a31b-027859234183 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:43.342556 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c05450-571e-4455-8bab-886586d6a1a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:43.344186 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c05450-571e-4455-8bab-886586d6a1a4 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:43.348139 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa4f59-fc32-437d-a31b-027859234183 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:43.349709 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa4f59-fc32-437d-a31b-027859234183 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:43.355727 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-88c05450-571e-4455-8bab-886586d6a1a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:43.355727 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:43.355727 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:43.355727 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:43.355727 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:43.355727 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:43.355727 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:43.355727 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:43.355727 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:43.355727 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:43.355727 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:43.355727 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:43.355727 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 03:51:43.355727 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 03:51:43.355727 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 03:51:43.356668 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 03:51:43.356668 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:43.356668 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:43.356668 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:43.356668 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:43.356668 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:43.356668 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:43.356668 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:43.356668 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:43.356668 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:43.356668 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:43.356668 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:43.356668 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:43.356668 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:43.356668 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:43.356668 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:43.356668 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:43.358190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 03:51:43.358190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 03:51:43.358190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 03:51:43.358190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 03:51:43.358190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 03:51:43.358190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 03:51:43.358190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:43.358190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:43.358190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 326/634] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:51:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:43.366037 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-f1aa4f59-fc32-437d-a31b-027859234183 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:43.366037 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:43.366037 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:43.366037 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:43.366037 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:43.366037 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:43.366037 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:43.366037 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:43.366037 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:43.366037 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:43.366037 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:43.366037 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:43.366037 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 03:51:43.366037 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 03:51:43.366037 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 03:51:43.366941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 03:51:43.366941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:43.366941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:43.366941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:43.366941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:43.366941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:43.366941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:43.366941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:43.366941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:43.366941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:43.366941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:43.366941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:43.366941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:43.366941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:43.366941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:43.366941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:43.366941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:43.367835 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 03:51:43.367835 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 03:51:43.367835 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 03:51:43.367835 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 03:51:43.367835 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 03:51:43.367835 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 03:51:43.367835 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:43.367835 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:43.368257 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c05450-571e-4455-8bab-886586d6a1a4 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:43.373558 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 309/635] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:51:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:43.374564 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa4f59-fc32-437d-a31b-027859234183 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:43.460936 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:43.481260 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa4f59-fc32-437d-a31b-027859234183 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:43.485996 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c05450-571e-4455-8bab-886586d6a1a4 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:43.518007 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24606257-3815-42bc-a577-32c48926bb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:43.518648 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24606257-3815-42bc-a577-32c48926bb18 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:43.518920 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24606257-3815-42bc-a577-32c48926bb18 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:43.519201 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24606257-3815-42bc-a577-32c48926bb18 None admin] PATH_INFO: `/v3/projects` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:43.519991 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24606257-3815-42bc-a577-32c48926bb18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:43.520312 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24606257-3815-42bc-a577-32c48926bb18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:43.521768 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24606257-3815-42bc-a577-32c48926bb18 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:43.523674 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5b7f0-c5a9-4400-a0da-4ee5a2b99691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:43.524589 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5b7f0-c5a9-4400-a0da-4ee5a2b99691 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:43.525064 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5b7f0-c5a9-4400-a0da-4ee5a2b99691 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:43.525552 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5b7f0-c5a9-4400-a0da-4ee5a2b99691 None admin] PATH_INFO: `/v3/projects` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:43.526432 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5b7f0-c5a9-4400-a0da-4ee5a2b99691 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:43.526925 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5b7f0-c5a9-4400-a0da-4ee5a2b99691 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:43.528569 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5b7f0-c5a9-4400-a0da-4ee5a2b99691 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:43.539976 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 310/636] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 03:51:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:43.541329 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24606257-3815-42bc-a577-32c48926bb18 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:43.552392 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 327/637] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 03:51:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:43.553622 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5b7f0-c5a9-4400-a0da-4ee5a2b99691 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:43.568794 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:43.644830 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24606257-3815-42bc-a577-32c48926bb18 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:43.659779 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5b7f0-c5a9-4400-a0da-4ee5a2b99691 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:43.679744 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eeb39f-ebd8-449d-87a9-b201fbb67acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:43.680355 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eeb39f-ebd8-449d-87a9-b201fbb67acb None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:43.680666 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eeb39f-ebd8-449d-87a9-b201fbb67acb None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:43.680941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eeb39f-ebd8-449d-87a9-b201fbb67acb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:43.681654 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eeb39f-ebd8-449d-87a9-b201fbb67acb None admin] RBAC: Adding query filter params (role.id=ad0744b06a1644a5bbbe3f145f6ac4e0, scope.project.id=b09192159c884e73bef832a38e2d5e7c, user.id=cfee7b193add48478b5240198b1aa602) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:43.681960 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eeb39f-ebd8-449d-87a9-b201fbb67acb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:43.683375 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eeb39f-ebd8-449d-87a9-b201fbb67acb None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:43.696515 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 311/638] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:51:43 2022] GET /identity/v3/role_assignments?user.id=cfee7b193add48478b5240198b1aa602&scope.project.id=b09192159c884e73bef832a38e2d5e7c&role.id=ad0744b06a1644a5bbbe3f145f6ac4e0 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:43.706367 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394e20c-bc45-4843-ae7f-6dff500c88fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:43.706989 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394e20c-bc45-4843-ae7f-6dff500c88fb None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:43.707313 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394e20c-bc45-4843-ae7f-6dff500c88fb None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:43.707594 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394e20c-bc45-4843-ae7f-6dff500c88fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:43.708327 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394e20c-bc45-4843-ae7f-6dff500c88fb None admin] RBAC: Adding query filter params (role.id=ad0744b06a1644a5bbbe3f145f6ac4e0, scope.project.id=b09192159c884e73bef832a38e2d5e7c, user.id=00454605826e4d6593d2d6aa331ebdc6) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:43.708712 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394e20c-bc45-4843-ae7f-6dff500c88fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:43.710157 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394e20c-bc45-4843-ae7f-6dff500c88fb None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:43.717928 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 328/639] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:51:43 2022] GET /identity/v3/role_assignments?user.id=00454605826e4d6593d2d6aa331ebdc6&scope.project.id=b09192159c884e73bef832a38e2d5e7c&role.id=ad0744b06a1644a5bbbe3f145f6ac4e0 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:44.365375 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc865243-165f-49c4-be04-b023aba52325 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:44.366070 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc865243-165f-49c4-be04-b023aba52325 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:44.366070 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc865243-165f-49c4-be04-b023aba52325 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:44.367406 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 312/640] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:44.372744 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7898c-e9c0-4255-a85d-a312562ac201 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:44.373577 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7898c-e9c0-4255-a85d-a312562ac201 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:44.374058 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7898c-e9c0-4255-a85d-a312562ac201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:44.393131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-93e7898c-e9c0-4255-a85d-a312562ac201 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:44.394555 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-93e7898c-e9c0-4255-a85d-a312562ac201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:44.463342 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 329/641] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:44.791797 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc865243-165f-49c4-be04-b023aba52325 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:44.801389 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:44.898049 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc865243-165f-49c4-be04-b023aba52325 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:44.938710 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027bc2e0-0238-41d0-9934-9a37d279745b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:44.939357 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bc2e0-0238-41d0-9934-9a37d279745b None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:44.939636 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bc2e0-0238-41d0-9934-9a37d279745b None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:44.939912 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bc2e0-0238-41d0-9934-9a37d279745b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:44.951802 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027bc2e0-0238-41d0-9934-9a37d279745b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:44.957069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-027bc2e0-0238-41d0-9934-9a37d279745b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:51:44.957069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:44.957069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:44.957069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:44.957069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:44.957069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:44.957069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:44.957069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:44.957069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:44.957069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:44.957069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:44.957069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:44.957069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:44.957069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:44.957069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:44.957069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:44.958086 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:44.958086 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:44.958086 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:44.958086 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:44.958086 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:44.958086 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:44.958086 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:44.958086 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:44.958086 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:44.958086 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:44.958086 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:44.958086 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:44.958086 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:44.958086 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:44.958086 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:44.958086 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:44.959010 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:44.959010 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:44.959010 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:44.959010 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:44.959010 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:44.959010 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:44.959010 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:44.959010 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:44.959010 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:44.959010 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:44.959010 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:51:44.959010 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:44.959010 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 313/642] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 03:51:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:44.963914 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7898c-e9c0-4255-a85d-a312562ac201 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:44.972034 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:45.070192 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7898c-e9c0-4255-a85d-a312562ac201 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:45.103526 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476f05c-6530-47df-b1c8-b800ad21e050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:45.104132 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476f05c-6530-47df-b1c8-b800ad21e050 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:45.104407 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476f05c-6530-47df-b1c8-b800ad21e050 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:45.104707 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476f05c-6530-47df-b1c8-b800ad21e050 None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:45.105356 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476f05c-6530-47df-b1c8-b800ad21e050 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:45.105656 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476f05c-6530-47df-b1c8-b800ad21e050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:45.107610 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476f05c-6530-47df-b1c8-b800ad21e050 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:45.115962 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 330/643] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:51:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:45.121450 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027bc2e0-0238-41d0-9934-9a37d279745b None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:45.195469 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:45.231934 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027bc2e0-0238-41d0-9934-9a37d279745b None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:45.267618 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62926c73-6261-4614-91dc-51cb13cdcad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:45.268518 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62926c73-6261-4614-91dc-51cb13cdcad0 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:45.268939 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62926c73-6261-4614-91dc-51cb13cdcad0 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:45.269378 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62926c73-6261-4614-91dc-51cb13cdcad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:45.280385 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62926c73-6261-4614-91dc-51cb13cdcad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:45.282088 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62926c73-6261-4614-91dc-51cb13cdcad0 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:45.297234 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-62926c73-6261-4614-91dc-51cb13cdcad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:45.297234 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:45.297234 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:45.297234 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:45.297234 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:45.297234 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:45.297234 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:45.297234 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:45.297234 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:45.297234 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:45.297234 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:45.297234 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:45.297234 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:45.297234 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:45.297234 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:45.297234 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:45.298402 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:45.298402 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:45.298402 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:45.298402 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:45.298402 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:45.298402 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:45.298402 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:45.298402 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:45.298402 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:45.298402 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:45.298402 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:45.298402 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:45.298402 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:45.298402 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:45.298402 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:45.298402 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:45.298402 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:45.299508 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:45.299508 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:45.299508 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:45.301186 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 314/644] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:45.307035 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476f05c-6530-47df-b1c8-b800ad21e050 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:45.318449 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a96fb4-a857-4f23-bb5c-d5516c2385ef None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:45.318812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a96fb4-a857-4f23-bb5c-d5516c2385ef None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:45.319098 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a96fb4-a857-4f23-bb5c-d5516c2385ef None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:45.320749 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 315/645] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 03:51:45.325567 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b4f62-3ff6-48fa-a6b7-b9b15a70ba88 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:45.325894 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b4f62-3ff6-48fa-a6b7-b9b15a70ba88 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:45.326262 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b4f62-3ff6-48fa-a6b7-b9b15a70ba88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:45.346634 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-273b4f62-3ff6-48fa-a6b7-b9b15a70ba88 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:45.348391 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-273b4f62-3ff6-48fa-a6b7-b9b15a70ba88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:45.392662 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:45.434332 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 316/646] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 03:51:45.435682 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476f05c-6530-47df-b1c8-b800ad21e050 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:45.470193 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e0ac0-da67-45d3-8bb4-8df3976631a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:45.470801 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e0ac0-da67-45d3-8bb4-8df3976631a7 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:45.471078 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e0ac0-da67-45d3-8bb4-8df3976631a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:45.471351 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e0ac0-da67-45d3-8bb4-8df3976631a7 None admin] PATH_INFO: `/v3/domains` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:45.471991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e0ac0-da67-45d3-8bb4-8df3976631a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:45.472294 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e0ac0-da67-45d3-8bb4-8df3976631a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:45.473705 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e0ac0-da67-45d3-8bb4-8df3976631a7 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:45.486425 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 331/647] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:45.491811 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b4f62-3ff6-48fa-a6b7-b9b15a70ba88 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:45.545574 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:45.597996 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b4f62-3ff6-48fa-a6b7-b9b15a70ba88 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:45.633331 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc36f5-9d98-4825-a19b-72444df073c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:45.633961 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc36f5-9d98-4825-a19b-72444df073c6 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:45.634279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc36f5-9d98-4825-a19b-72444df073c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:45.634555 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc36f5-9d98-4825-a19b-72444df073c6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:45.642235 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc36f5-9d98-4825-a19b-72444df073c6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:45.643758 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc36f5-9d98-4825-a19b-72444df073c6 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:45.656132 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-32fc36f5-9d98-4825-a19b-72444df073c6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 03:51:45.656132 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:45.656132 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:45.656132 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:45.656132 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:45.656132 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:45.656132 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:45.656132 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:45.656132 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:45.656132 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:45.656132 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:45.656132 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:45.656132 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 03:51:45.656132 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 03:51:45.656132 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 03:51:45.656132 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 03:51:45.657159 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:45.657159 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:45.657159 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 03:51:45.657159 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:45.657159 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 03:51:45.657159 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:45.657159 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:45.657159 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:45.657159 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:45.657159 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:45.657159 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:45.657159 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:45.657159 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:45.657159 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:45.657159 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:45.657159 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:45.657159 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:45.657159 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:45.658179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:45.658179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:45.658179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 03:51:45.658179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 03:51:45.658179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 03:51:45.658179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 03:51:45.658179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 03:51:45.658179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 03:51:45.658179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 03:51:45.658179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:45.658179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 317/648] 10.222.0.43 () {56 vars in 1093 bytes} [Fri Aug 19 03:51:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:45.670117 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e0ac0-da67-45d3-8bb4-8df3976631a7 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:45.774201 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e0ac0-da67-45d3-8bb4-8df3976631a7 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:45.802011 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:45.812046 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36e808-fcaa-405c-98b4-ff79ea1f392b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:45.812927 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36e808-fcaa-405c-98b4-ff79ea1f392b None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:45.813402 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36e808-fcaa-405c-98b4-ff79ea1f392b None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:45.813884 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36e808-fcaa-405c-98b4-ff79ea1f392b None admin] PATH_INFO: `/v3/users` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:45.814810 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36e808-fcaa-405c-98b4-ff79ea1f392b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:45.815323 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36e808-fcaa-405c-98b4-ff79ea1f392b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:45.817017 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36e808-fcaa-405c-98b4-ff79ea1f392b None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:45.826601 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc36f5-9d98-4825-a19b-72444df073c6 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:45.838451 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 332/649] 10.222.0.43 () {56 vars in 1133 bytes} [Fri Aug 19 03:51:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:45.844996 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36e808-fcaa-405c-98b4-ff79ea1f392b None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:45.939015 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc36f5-9d98-4825-a19b-72444df073c6 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:45.948415 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:45.965398 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36e808-fcaa-405c-98b4-ff79ea1f392b None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:45.995079 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19845f6b-04a4-43a7-83b6-0916785c7234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:45.995950 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19845f6b-04a4-43a7-83b6-0916785c7234 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:45.996452 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19845f6b-04a4-43a7-83b6-0916785c7234 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:45.996956 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19845f6b-04a4-43a7-83b6-0916785c7234 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:45.998032 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19845f6b-04a4-43a7-83b6-0916785c7234 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:46.000619 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19845f6b-04a4-43a7-83b6-0916785c7234 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:46.004417 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d9a14-5387-4a22-898a-d9adda87848c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:46.005348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d9a14-5387-4a22-898a-d9adda87848c None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:46.005872 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d9a14-5387-4a22-898a-d9adda87848c None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:46.006454 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d9a14-5387-4a22-898a-d9adda87848c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:46.021615 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-19845f6b-04a4-43a7-83b6-0916785c7234 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 03:51:46.021615 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:46.021615 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 03:51:46.021615 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 03:51:46.021615 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 03:51:46.021615 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 03:51:46.021615 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 03:51:46.021615 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:51:46.021615 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 03:51:46.021615 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:46.021615 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 03:51:46.021615 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:46.021615 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:46.021615 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:46.021615 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:46.021615 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:46.021615 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:46.022697 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:46.022697 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:46.022697 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:46.022697 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:46.022697 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:46.022697 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:46.022697 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 03:51:46.022697 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 03:51:46.022697 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 03:51:46.022697 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 03:51:46.022697 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:46.022697 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:46.022697 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:46.022697 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:46.022697 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:46.022697 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:46.023569 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:46.023569 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:46.023569 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:46.023569 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:46.023569 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:46.023569 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:46.023569 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:46.023569 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:46.023569 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:46.023569 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:46.023569 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 03:51:46.023569 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:51:46.023569 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 03:51:46.023569 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:46.029467 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 318/650] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Aug 19 03:51:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 03:51:46.033620 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19845f6b-04a4-43a7-83b6-0916785c7234 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:46.071358 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:46.085947 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d9a14-5387-4a22-898a-d9adda87848c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:46.087411 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d9a14-5387-4a22-898a-d9adda87848c None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:46.146738 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19845f6b-04a4-43a7-83b6-0916785c7234 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:46.184101 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb15200-6d0b-4465-8869-45bf6478712e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:46.184824 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb15200-6d0b-4465-8869-45bf6478712e None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:46.185699 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb15200-6d0b-4465-8869-45bf6478712e None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:46.185978 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb15200-6d0b-4465-8869-45bf6478712e None admin] PATH_INFO: `/v3/services` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:46.186632 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb15200-6d0b-4465-8869-45bf6478712e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:46.186938 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb15200-6d0b-4465-8869-45bf6478712e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:46.188322 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb15200-6d0b-4465-8869-45bf6478712e None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:46.188768 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 333/651] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:51:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 03:51:46.192945 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 319/652] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Aug 19 03:51:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:46.194380 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df447881-3d4b-43b5-8456-289aeb67a935 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:46.194503 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653c3f5-3df2-4e94-af03-3297a2929474 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:46.194673 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df447881-3d4b-43b5-8456-289aeb67a935 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:46.194784 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653c3f5-3df2-4e94-af03-3297a2929474 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:46.194940 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df447881-3d4b-43b5-8456-289aeb67a935 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:46.195034 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653c3f5-3df2-4e94-af03-3297a2929474 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:46.200678 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 334/653] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:46.200678 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653c3f5-3df2-4e94-af03-3297a2929474 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:46.201395 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 320/654] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:46.201395 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df447881-3d4b-43b5-8456-289aeb67a935 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:46.236274 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:46.283952 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:46.299860 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653c3f5-3df2-4e94-af03-3297a2929474 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:46.301346 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df447881-3d4b-43b5-8456-289aeb67a935 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:46.334918 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc35cb-3c78-419f-a535-63e83bef5410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:46.335604 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc35cb-3c78-419f-a535-63e83bef5410 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:46.335885 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc35cb-3c78-419f-a535-63e83bef5410 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:46.336104 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a7b1d-8f87-4903-b887-3e5f9ab6d9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:46.336212 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc35cb-3c78-419f-a535-63e83bef5410 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:46.336676 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a7b1d-8f87-4903-b887-3e5f9ab6d9ca None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:46.337007 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a7b1d-8f87-4903-b887-3e5f9ab6d9ca None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:46.337436 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a7b1d-8f87-4903-b887-3e5f9ab6d9ca None admin] PATH_INFO: `/v3/services` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:46.338066 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a7b1d-8f87-4903-b887-3e5f9ab6d9ca None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:46.338373 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a7b1d-8f87-4903-b887-3e5f9ab6d9ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:46.339762 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a7b1d-8f87-4903-b887-3e5f9ab6d9ca None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:46.346058 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 321/655] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Aug 19 03:51:46 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:46.347841 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916fdda-bbea-4746-9bd5-7d816593eb7b None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:46.348273 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916fdda-bbea-4746-9bd5-7d816593eb7b None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:46.348585 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916fdda-bbea-4746-9bd5-7d816593eb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:46.348779 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc35cb-3c78-419f-a535-63e83bef5410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:46.350254 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc35cb-3c78-419f-a535-63e83bef5410 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:46.365947 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-debc35cb-3c78-419f-a535-63e83bef5410 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:46.365947 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:46.365947 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:46.365947 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:46.365947 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:46.365947 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:46.365947 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:46.365947 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:46.365947 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:46.365947 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:46.365947 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:46.365947 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:46.365947 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:46.365947 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:46.365947 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:46.365947 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:46.366990 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:46.366990 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:46.366990 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:46.366990 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:46.366990 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:46.366990 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:46.366990 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:46.366990 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:46.366990 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:46.366990 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:46.366990 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:46.366990 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:46.366990 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:46.366990 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:46.366990 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:46.366990 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:46.366990 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:46.367937 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:46.367937 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:46.367937 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:46.369487 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-0916fdda-bbea-4746-9bd5-7d816593eb7b None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:46.370741 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-0916fdda-bbea-4746-9bd5-7d816593eb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:46.372027 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 335/656] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:46.373801 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40ea35-218d-4c7e-9cdf-5d9a0e72fd09 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:46.374088 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40ea35-218d-4c7e-9cdf-5d9a0e72fd09 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:46.374378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40ea35-218d-4c7e-9cdf-5d9a0e72fd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:46.394461 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-6a40ea35-218d-4c7e-9cdf-5d9a0e72fd09 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:46.395691 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-6a40ea35-218d-4c7e-9cdf-5d9a0e72fd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:46.448642 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 322/657] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:46.450164 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916fdda-bbea-4746-9bd5-7d816593eb7b None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:46.480538 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 336/658] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:46.499848 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:46.577542 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916fdda-bbea-4746-9bd5-7d816593eb7b None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:46.613161 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534aedda-75d7-4b09-964f-9b3c52b9e84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:46.614101 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534aedda-75d7-4b09-964f-9b3c52b9e84c None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:46.614521 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534aedda-75d7-4b09-964f-9b3c52b9e84c None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:46.614933 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534aedda-75d7-4b09-964f-9b3c52b9e84c None admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:46.615733 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534aedda-75d7-4b09-964f-9b3c52b9e84c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:46.616172 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534aedda-75d7-4b09-964f-9b3c52b9e84c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:46.617692 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534aedda-75d7-4b09-964f-9b3c52b9e84c None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:46.630620 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 323/659] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:46.636292 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40ea35-218d-4c7e-9cdf-5d9a0e72fd09 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:46.706454 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:46.741824 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40ea35-218d-4c7e-9cdf-5d9a0e72fd09 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:46.781176 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6ce97-f3ef-41db-8ef6-e00135ae4cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:46.782207 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6ce97-f3ef-41db-8ef6-e00135ae4cd6 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:46.782693 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6ce97-f3ef-41db-8ef6-e00135ae4cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:46.783182 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6ce97-f3ef-41db-8ef6-e00135ae4cd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:46.789444 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534aedda-75d7-4b09-964f-9b3c52b9e84c None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:46.790791 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6ce97-f3ef-41db-8ef6-e00135ae4cd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:46.792454 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6ce97-f3ef-41db-8ef6-e00135ae4cd6 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:46.805131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-19b6ce97-f3ef-41db-8ef6-e00135ae4cd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:46.805131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:46.805131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:46.805131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:46.805131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:46.805131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:46.805131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:46.805131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:46.805131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:46.805131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:46.805131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:46.805131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:46.805131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 03:51:46.805131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 03:51:46.805131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 03:51:46.806240 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 03:51:46.806240 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:46.806240 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:46.806240 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:46.806240 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:46.806240 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:46.806240 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:46.806240 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:46.806240 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:46.806240 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:46.806240 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:46.806240 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:46.806240 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:46.806240 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:46.806240 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:46.806240 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:46.806240 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:46.807403 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 03:51:46.807403 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 03:51:46.807403 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 03:51:46.807403 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 03:51:46.807403 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 03:51:46.807403 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 03:51:46.807403 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:46.807403 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:46.809388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 337/660] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:51:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:46.815579 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6ce97-f3ef-41db-8ef6-e00135ae4cd6 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:46.896255 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:46.907747 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534aedda-75d7-4b09-964f-9b3c52b9e84c None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:46.924398 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6ce97-f3ef-41db-8ef6-e00135ae4cd6 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:46.943592 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af98a4d-612f-4288-93f0-15d0619ea1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:46.944220 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af98a4d-612f-4288-93f0-15d0619ea1e5 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:46.944644 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af98a4d-612f-4288-93f0-15d0619ea1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:46.944918 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af98a4d-612f-4288-93f0-15d0619ea1e5 None admin] PATH_INFO: `/v3/services/image` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:46.945487 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af98a4d-612f-4288-93f0-15d0619ea1e5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:46.946850 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af98a4d-612f-4288-93f0-15d0619ea1e5 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:46.951217 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:46.956622 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-4af98a4d-612f-4288-93f0-15d0619ea1e5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 03:51:46.956622 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:46.956622 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 03:51:46.956622 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 03:51:46.956622 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 03:51:46.956622 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 03:51:46.956622 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 03:51:46.956622 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:51:46.956622 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 03:51:46.956622 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:46.956622 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 03:51:46.956622 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:46.956622 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:46.956622 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:46.956622 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:46.956622 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:46.956622 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:46.957594 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:46.957594 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:46.957594 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:46.957594 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:46.957594 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:46.957594 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:46.957594 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 03:51:46.957594 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 03:51:46.957594 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 03:51:46.957594 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 03:51:46.957594 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:46.957594 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:46.957594 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:46.957594 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:46.957594 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:46.957594 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:46.958457 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:46.958457 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:46.958457 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:46.958457 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:46.958457 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:46.958457 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:46.958457 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:46.958457 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:46.958457 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:46.958457 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:46.958457 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 03:51:46.958457 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:51:46.958457 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 03:51:46.958457 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:46.958457 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 324/661] 10.222.0.43 () {56 vars in 1105 bytes} [Fri Aug 19 03:51:46 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 03:51:46.959321 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af98a4d-612f-4288-93f0-15d0619ea1e5 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:46.966860 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36861d8-c400-43b1-a9db-c50b87a18b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:46.967474 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36861d8-c400-43b1-a9db-c50b87a18b04 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:46.967754 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36861d8-c400-43b1-a9db-c50b87a18b04 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:46.968029 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36861d8-c400-43b1-a9db-c50b87a18b04 None admin] PATH_INFO: `/v3/projects` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:46.968753 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36861d8-c400-43b1-a9db-c50b87a18b04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:46.969063 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36861d8-c400-43b1-a9db-c50b87a18b04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:46.970943 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36861d8-c400-43b1-a9db-c50b87a18b04 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:46.984044 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 338/662] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 03:51:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:46.984044 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36861d8-c400-43b1-a9db-c50b87a18b04 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:47.072308 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af98a4d-612f-4288-93f0-15d0619ea1e5 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:47.098533 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36861d8-c400-43b1-a9db-c50b87a18b04 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:47.107807 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac5ac3-4d06-40ea-8ed2-4ffa0b0164c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:47.108435 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac5ac3-4d06-40ea-8ed2-4ffa0b0164c6 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:47.108735 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac5ac3-4d06-40ea-8ed2-4ffa0b0164c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:47.109010 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac5ac3-4d06-40ea-8ed2-4ffa0b0164c6 None admin] PATH_INFO: `/v3/services/network` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:47.109575 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac5ac3-4d06-40ea-8ed2-4ffa0b0164c6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:47.110935 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac5ac3-4d06-40ea-8ed2-4ffa0b0164c6 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:47.120004 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-68ac5ac3-4d06-40ea-8ed2-4ffa0b0164c6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 03:51:47.120004 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:47.120004 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 03:51:47.120004 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 03:51:47.120004 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 03:51:47.120004 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 03:51:47.120004 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 03:51:47.120004 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:51:47.120004 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 03:51:47.120004 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:47.120004 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 03:51:47.120004 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:47.120004 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:47.120004 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:47.120004 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:47.120004 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:47.120004 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:47.121106 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:47.121106 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:47.121106 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:47.121106 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:47.121106 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:47.121106 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:47.121106 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 03:51:47.121106 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 03:51:47.121106 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 03:51:47.121106 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 03:51:47.121106 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:47.121106 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:47.121106 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:47.121106 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:47.121106 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:47.121106 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:47.122107 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:47.122107 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:47.122107 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:47.122107 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:47.122107 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:47.122107 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:47.122107 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:47.122107 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:47.122107 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:47.122107 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:47.122107 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 03:51:47.122107 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:51:47.122107 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 03:51:47.122107 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:47.122107 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 325/663] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:51:46 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:47.125656 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac5ac3-4d06-40ea-8ed2-4ffa0b0164c6 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:47.136611 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526acbe-b7d7-4875-aae1-a6d4ed55012d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:47.137212 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526acbe-b7d7-4875-aae1-a6d4ed55012d None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:47.137487 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526acbe-b7d7-4875-aae1-a6d4ed55012d None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:47.137755 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526acbe-b7d7-4875-aae1-a6d4ed55012d None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:47.138399 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526acbe-b7d7-4875-aae1-a6d4ed55012d None admin] RBAC: Adding query filter params (name=image) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:47.138699 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526acbe-b7d7-4875-aae1-a6d4ed55012d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:47.140338 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526acbe-b7d7-4875-aae1-a6d4ed55012d None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:47.148924 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 339/664] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:47.148924 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526acbe-b7d7-4875-aae1-a6d4ed55012d None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:47.151374 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:47.208666 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:47.240452 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac5ac3-4d06-40ea-8ed2-4ffa0b0164c6 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:47.262100 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526acbe-b7d7-4875-aae1-a6d4ed55012d None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:47.277973 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e57b98-7b65-49ab-a7bc-06b0ca3eeb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:47.279172 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e57b98-7b65-49ab-a7bc-06b0ca3eeb13 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:47.279439 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e57b98-7b65-49ab-a7bc-06b0ca3eeb13 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:47.279711 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e57b98-7b65-49ab-a7bc-06b0ca3eeb13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:47.280440 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e57b98-7b65-49ab-a7bc-06b0ca3eeb13 None admin] RBAC: Adding query filter params (role.id=e154509f216e4ae59f74044aa234ddde, scope.project.id=b09192159c884e73bef832a38e2d5e7c, user.id=7aab3a88f9d0401db32fbaadef2711ee) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:47.280791 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e57b98-7b65-49ab-a7bc-06b0ca3eeb13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:47.282198 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e57b98-7b65-49ab-a7bc-06b0ca3eeb13 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:47.287601 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 326/665] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:51:47 2022] GET /identity/v3/role_assignments?user.id=7aab3a88f9d0401db32fbaadef2711ee&scope.project.id=b09192159c884e73bef832a38e2d5e7c&role.id=e154509f216e4ae59f74044aa234ddde => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:47.288469 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e57b98-7b65-49ab-a7bc-06b0ca3eeb13 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:47.315546 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753b494-7702-4d43-8e67-6e8316cd90ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:47.317122 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753b494-7702-4d43-8e67-6e8316cd90ab None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:47.317592 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753b494-7702-4d43-8e67-6e8316cd90ab None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:47.318116 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753b494-7702-4d43-8e67-6e8316cd90ab None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:47.318953 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753b494-7702-4d43-8e67-6e8316cd90ab None admin] RBAC: Adding query filter params (name=network) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:47.320138 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753b494-7702-4d43-8e67-6e8316cd90ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:47.322250 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753b494-7702-4d43-8e67-6e8316cd90ab None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:47.330655 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 340/666] 10.222.0.43 () {56 vars in 1112 bytes} [Fri Aug 19 03:51:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:47.337326 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753b494-7702-4d43-8e67-6e8316cd90ab None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:47.397026 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:47.425832 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e57b98-7b65-49ab-a7bc-06b0ca3eeb13 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:47.465616 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1789d-18ef-4dee-8b8e-beaaba745711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:47.467581 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1789d-18ef-4dee-8b8e-beaaba745711 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:47.468038 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1789d-18ef-4dee-8b8e-beaaba745711 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:47.468578 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1789d-18ef-4dee-8b8e-beaaba745711 None admin] PATH_INFO: `/v3/services` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:47.469404 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1789d-18ef-4dee-8b8e-beaaba745711 None admin] RBAC: Adding query filter params (type=image) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:47.469894 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1789d-18ef-4dee-8b8e-beaaba745711 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:47.471497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1789d-18ef-4dee-8b8e-beaaba745711 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:47.476394 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753b494-7702-4d43-8e67-6e8316cd90ab None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:47.478107 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 327/667] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:47 2022] GET /identity/v3/services?type=image => generated 122 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:47.505458 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:47.527664 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a3b00-a089-42bf-bc10-0e6244288dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:47.528286 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a3b00-a089-42bf-bc10-0e6244288dfe None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:47.529162 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a3b00-a089-42bf-bc10-0e6244288dfe None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:47.529436 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a3b00-a089-42bf-bc10-0e6244288dfe None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:47.530062 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a3b00-a089-42bf-bc10-0e6244288dfe None admin] RBAC: Adding query filter params (type=network) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:47.530365 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a3b00-a089-42bf-bc10-0e6244288dfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:47.531745 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a3b00-a089-42bf-bc10-0e6244288dfe None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:47.542147 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 341/668] 10.222.0.43 () {56 vars in 1112 bytes} [Fri Aug 19 03:51:47 2022] GET /identity/v3/services?type=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:48.589442 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafbf85-564c-4479-967f-981bf5f1abc9 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:48.589937 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafbf85-564c-4479-967f-981bf5f1abc9 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:48.589937 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafbf85-564c-4479-967f-981bf5f1abc9 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:48.591507 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 328/669] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:48.596959 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f843f-c681-481e-be68-975065f2d345 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:48.597393 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f843f-c681-481e-be68-975065f2d345 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:48.597567 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f843f-c681-481e-be68-975065f2d345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:48.616236 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-9d1f843f-c681-481e-be68-975065f2d345 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:48.617505 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-9d1f843f-c681-481e-be68-975065f2d345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:48.691927 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 342/670] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:49.020639 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafbf85-564c-4479-967f-981bf5f1abc9 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:49.132324 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafbf85-564c-4479-967f-981bf5f1abc9 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:49.168612 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d168899-5169-40e4-8134-a27281576078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:49.170144 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d168899-5169-40e4-8134-a27281576078 None admin] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:49.170683 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d168899-5169-40e4-8134-a27281576078 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:49.171189 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d168899-5169-40e4-8134-a27281576078 None admin] PATH_INFO: `/v3/services` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:49.172043 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d168899-5169-40e4-8134-a27281576078 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:49.173666 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d168899-5169-40e4-8134-a27281576078 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:49.192714 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 329/671] 10.222.0.43 () {60 vars in 1141 bytes} [Fri Aug 19 03:51:49 2022] POST /identity/v3/services => generated 251 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:51:49.570255 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb95ba-a660-41f6-bde5-6cde01bc2ae5 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:49.570662 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb95ba-a660-41f6-bde5-6cde01bc2ae5 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:49.570846 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb95ba-a660-41f6-bde5-6cde01bc2ae5 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:49.572384 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 343/672] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:49.578096 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74772f36-3e80-48c1-aa1c-58e6acd92e3a None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:49.578388 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74772f36-3e80-48c1-aa1c-58e6acd92e3a None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:49.578665 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74772f36-3e80-48c1-aa1c-58e6acd92e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:49.591851 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:49.597505 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-74772f36-3e80-48c1-aa1c-58e6acd92e3a None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:49.599216 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-74772f36-3e80-48c1-aa1c-58e6acd92e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:49.690323 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 330/673] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:49.778721 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cc2ce-310c-41a4-9fc8-e4ec8ee85622 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:49.779230 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cc2ce-310c-41a4-9fc8-e4ec8ee85622 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:49.779307 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cc2ce-310c-41a4-9fc8-e4ec8ee85622 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:49.780924 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 344/674] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:49.786090 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e523e-b102-4596-83b9-e225f05f59c9 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:49.786389 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e523e-b102-4596-83b9-e225f05f59c9 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:49.786671 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e523e-b102-4596-83b9-e225f05f59c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:49.791972 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cdfef7-61c9-4769-82bf-a45a02ee9e33 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:49.792258 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cdfef7-61c9-4769-82bf-a45a02ee9e33 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:49.792568 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cdfef7-61c9-4769-82bf-a45a02ee9e33 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:49.794266 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 345/675] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 03:51:49.806399 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9194a6-9c0a-40e0-b3c9-13aa8faf90c6 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:49.806848 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9194a6-9c0a-40e0-b3c9-13aa8faf90c6 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:49.807230 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9194a6-9c0a-40e0-b3c9-13aa8faf90c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:49.809821 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-224e523e-b102-4596-83b9-e225f05f59c9 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:49.811003 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-224e523e-b102-4596-83b9-e225f05f59c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:49.827865 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-2e9194a6-9c0a-40e0-b3c9-13aa8faf90c6 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:49.829008 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-2e9194a6-9c0a-40e0-b3c9-13aa8faf90c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:49.889543 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 331/676] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:49.911311 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 346/677] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 03:51:50.038537 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e523e-b102-4596-83b9-e225f05f59c9 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:50.107041 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:50.148059 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e523e-b102-4596-83b9-e225f05f59c9 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:50.183527 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42cb3b-54ec-40f2-ae93-827bf17a5bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:50.184714 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42cb3b-54ec-40f2-ae93-827bf17a5bc7 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:50.185002 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42cb3b-54ec-40f2-ae93-827bf17a5bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:50.185280 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42cb3b-54ec-40f2-ae93-827bf17a5bc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:50.195715 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff42cb3b-54ec-40f2-ae93-827bf17a5bc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:50.201186 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-ff42cb3b-54ec-40f2-ae93-827bf17a5bc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:51:50.201186 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:50.201186 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:50.201186 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:50.201186 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:50.201186 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:50.201186 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:50.201186 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:50.201186 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:50.201186 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:50.201186 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:50.201186 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:50.201186 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:50.201186 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:50.201186 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:50.201186 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:50.202124 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:50.202124 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:50.202124 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:50.202124 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:50.202124 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:50.202124 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:50.202124 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:50.202124 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:50.202124 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:50.202124 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:50.202124 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:50.202124 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:50.202124 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:50.202124 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:50.202124 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:50.202124 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:50.203109 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:50.203109 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:50.203109 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:50.203109 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:50.203109 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:50.203109 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:50.203109 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:50.203109 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:50.203109 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:50.203109 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:50.203109 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:51:50.203109 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:50.203109 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 332/678] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 03:51:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:50.208138 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9194a6-9c0a-40e0-b3c9-13aa8faf90c6 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:50.245361 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42cb3b-54ec-40f2-ae93-827bf17a5bc7 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:50.259070 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:50.328904 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9194a6-9c0a-40e0-b3c9-13aa8faf90c6 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:50.361611 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42cb3b-54ec-40f2-ae93-827bf17a5bc7 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:50.367050 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a43a80-f0eb-47fe-9e82-64fd79d7e022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:50.367664 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a43a80-f0eb-47fe-9e82-64fd79d7e022 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:50.367941 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a43a80-f0eb-47fe-9e82-64fd79d7e022 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:50.368211 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a43a80-f0eb-47fe-9e82-64fd79d7e022 None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:50.368899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a43a80-f0eb-47fe-9e82-64fd79d7e022 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:50.369199 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a43a80-f0eb-47fe-9e82-64fd79d7e022 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:50.370665 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a43a80-f0eb-47fe-9e82-64fd79d7e022 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:50.384537 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 347/679] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:51:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:50.384537 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a43a80-f0eb-47fe-9e82-64fd79d7e022 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:50.397144 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:50.410133 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc261254-7cd2-46a8-becc-a09c1b5cb629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:50.410739 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc261254-7cd2-46a8-becc-a09c1b5cb629 None admin] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:50.411178 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc261254-7cd2-46a8-becc-a09c1b5cb629 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:50.411286 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc261254-7cd2-46a8-becc-a09c1b5cb629 None admin] PATH_INFO: `/v3/services` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:50.411961 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc261254-7cd2-46a8-becc-a09c1b5cb629 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:50.413370 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc261254-7cd2-46a8-becc-a09c1b5cb629 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:50.429722 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 333/680] 10.222.0.43 () {60 vars in 1141 bytes} [Fri Aug 19 03:51:50 2022] POST /identity/v3/services => generated 242 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 03:51:50.430403 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc261254-7cd2-46a8-becc-a09c1b5cb629 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:50.518960 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a43a80-f0eb-47fe-9e82-64fd79d7e022 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:50.521206 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:50.566527 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18b20e-cce6-436b-8249-c21168b198a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:50.567554 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18b20e-cce6-436b-8249-c21168b198a8 None admin] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:50.567554 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18b20e-cce6-436b-8249-c21168b198a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:50.567733 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18b20e-cce6-436b-8249-c21168b198a8 None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:50.568325 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18b20e-cce6-436b-8249-c21168b198a8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:50.569940 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18b20e-cce6-436b-8249-c21168b198a8 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:50.571796 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc261254-7cd2-46a8-becc-a09c1b5cb629 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:50.592580 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 348/681] 10.222.0.43 () {60 vars in 1141 bytes} [Fri Aug 19 03:51:50 2022] POST /identity/v3/services => generated 240 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:51:50.634937 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b4d78-c9f5-40e8-a1aa-c40a05f3337b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:50.635590 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b4d78-c9f5-40e8-a1aa-c40a05f3337b None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:50.635866 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b4d78-c9f5-40e8-a1aa-c40a05f3337b None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:50.636135 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b4d78-c9f5-40e8-a1aa-c40a05f3337b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:50.655099 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b4d78-c9f5-40e8-a1aa-c40a05f3337b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:50.657066 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b4d78-c9f5-40e8-a1aa-c40a05f3337b None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:50.677264 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-407b4d78-c9f5-40e8-a1aa-c40a05f3337b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:50.677264 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:50.677264 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:50.677264 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:50.677264 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:50.677264 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:50.677264 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:50.677264 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:50.677264 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:50.677264 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:50.677264 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:50.677264 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:50.677264 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:50.677264 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:50.677264 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:50.677264 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:50.678334 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:50.678334 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:50.678334 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:50.678334 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:50.678334 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:50.678334 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:50.678334 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:50.678334 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:50.678334 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:50.678334 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:50.678334 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:50.678334 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:50.678334 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:50.678334 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:50.678334 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:50.678334 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:50.678334 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:50.679296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:50.679296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:50.679296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:50.679914 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 334/682] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:50.685702 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18b20e-cce6-436b-8249-c21168b198a8 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:50.802522 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18b20e-cce6-436b-8249-c21168b198a8 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:50.838795 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00c176-0b33-49a2-a55b-124033e5733d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:50.839414 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00c176-0b33-49a2-a55b-124033e5733d None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:50.839694 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00c176-0b33-49a2-a55b-124033e5733d None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:50.839968 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00c176-0b33-49a2-a55b-124033e5733d None admin] PATH_INFO: `/v3/domains` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:50.840688 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00c176-0b33-49a2-a55b-124033e5733d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:50.840995 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00c176-0b33-49a2-a55b-124033e5733d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:50.842595 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00c176-0b33-49a2-a55b-124033e5733d None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:50.855674 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 349/683] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:50.861163 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b4d78-c9f5-40e8-a1aa-c40a05f3337b None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:51.015015 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:51.092577 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b4d78-c9f5-40e8-a1aa-c40a05f3337b None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:51.132982 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba0d8c-39bf-478e-9927-8d9e1a02986c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:51.133619 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba0d8c-39bf-478e-9927-8d9e1a02986c None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:51.133899 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba0d8c-39bf-478e-9927-8d9e1a02986c None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:51.134172 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba0d8c-39bf-478e-9927-8d9e1a02986c None admin] PATH_INFO: `/v3/users/nova` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:51.142415 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba0d8c-39bf-478e-9927-8d9e1a02986c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:51.143869 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba0d8c-39bf-478e-9927-8d9e1a02986c None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:51.156613 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-a8ba0d8c-39bf-478e-9927-8d9e1a02986c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 03:51:51.156613 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:51.156613 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:51.156613 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:51.156613 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:51.156613 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:51.156613 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:51.156613 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:51.156613 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:51.156613 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:51.156613 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:51.156613 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:51.156613 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 03:51:51.156613 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 03:51:51.156613 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 03:51:51.156613 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 03:51:51.157617 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:51.157617 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:51.157617 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 03:51:51.157617 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:51.157617 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 03:51:51.157617 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:51.157617 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:51.157617 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:51.157617 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:51.157617 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:51.157617 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:51.157617 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:51.157617 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:51.157617 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:51.157617 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:51.157617 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:51.157617 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:51.157617 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:51.158586 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:51.158586 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:51.158586 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 03:51:51.158586 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 03:51:51.158586 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 03:51:51.158586 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 03:51:51.158586 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 03:51:51.158586 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 03:51:51.158586 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 03:51:51.158586 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:51.158586 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 335/684] 10.222.0.43 () {56 vars in 1093 bytes} [Fri Aug 19 03:51:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:51.165438 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00c176-0b33-49a2-a55b-124033e5733d None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:51.188687 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:51.273934 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00c176-0b33-49a2-a55b-124033e5733d None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:51.314177 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d1ff2-f4d8-4298-b2e4-90869788d968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:51.315261 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d1ff2-f4d8-4298-b2e4-90869788d968 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:51.315734 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d1ff2-f4d8-4298-b2e4-90869788d968 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:51.316279 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d1ff2-f4d8-4298-b2e4-90869788d968 None admin] PATH_INFO: `/v3/users` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:51.317251 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d1ff2-f4d8-4298-b2e4-90869788d968 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:51.317752 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d1ff2-f4d8-4298-b2e4-90869788d968 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:51.319384 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d1ff2-f4d8-4298-b2e4-90869788d968 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:51.338057 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 350/685] 10.222.0.43 () {56 vars in 1133 bytes} [Fri Aug 19 03:51:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:51.348504 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba0d8c-39bf-478e-9927-8d9e1a02986c None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:51.441314 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:51.446518 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d398c8-8b66-4d5b-b947-e67ddf0b74ab None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:51.447071 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d398c8-8b66-4d5b-b947-e67ddf0b74ab None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:51.447556 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d398c8-8b66-4d5b-b947-e67ddf0b74ab None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:51.449366 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 351/686] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:51.455145 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa438e-b389-4d18-8ae4-6382c9a9e0e5 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:51.455432 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa438e-b389-4d18-8ae4-6382c9a9e0e5 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:51.455712 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa438e-b389-4d18-8ae4-6382c9a9e0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:51.457661 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba0d8c-39bf-478e-9927-8d9e1a02986c None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:51.474305 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-72aa438e-b389-4d18-8ae4-6382c9a9e0e5 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:51.475611 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-72aa438e-b389-4d18-8ae4-6382c9a9e0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:51.493799 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe56a7c-8242-42a5-b2c2-ec83a47a6284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:51.494718 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe56a7c-8242-42a5-b2c2-ec83a47a6284 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:51.495004 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe56a7c-8242-42a5-b2c2-ec83a47a6284 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:51.495284 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe56a7c-8242-42a5-b2c2-ec83a47a6284 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:51.509306 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe56a7c-8242-42a5-b2c2-ec83a47a6284 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:51.511069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe56a7c-8242-42a5-b2c2-ec83a47a6284 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:51.529826 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-cfe56a7c-8242-42a5-b2c2-ec83a47a6284 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:51.529826 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:51.529826 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:51.529826 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:51.529826 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:51.529826 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:51.529826 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:51.529826 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:51.529826 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:51.529826 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:51.529826 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:51.529826 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:51.529826 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:51.529826 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:51.529826 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:51.529826 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:51.530774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:51.530774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:51.530774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:51.530774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:51.530774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:51.530774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:51.530774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:51.530774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:51.530774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:51.530774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:51.530774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:51.530774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:51.530774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:51.530774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:51.530774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:51.530774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:51.530774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:51.531688 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:51.531688 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:51.531688 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:51.531688 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 336/687] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:51.537273 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe56a7c-8242-42a5-b2c2-ec83a47a6284 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:51.551408 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 352/688] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:51 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 03:51:51.642121 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe56a7c-8242-42a5-b2c2-ec83a47a6284 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:51.678751 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6fd86-dc4c-4647-8ade-cb4332867d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:51.679363 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6fd86-dc4c-4647-8ade-cb4332867d09 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:51.679640 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6fd86-dc4c-4647-8ade-cb4332867d09 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:51.679916 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6fd86-dc4c-4647-8ade-cb4332867d09 None admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:51.680581 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6fd86-dc4c-4647-8ade-cb4332867d09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:51.680883 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6fd86-dc4c-4647-8ade-cb4332867d09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:51.682244 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6fd86-dc4c-4647-8ade-cb4332867d09 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:51.689327 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:51.694678 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 337/689] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:51.700819 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa438e-b389-4d18-8ae4-6382c9a9e0e5 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:51.709668 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:51.804717 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa438e-b389-4d18-8ae4-6382c9a9e0e5 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:51.841953 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f62b3a-9e15-4356-8d7a-da780a7224cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:51.842730 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f62b3a-9e15-4356-8d7a-da780a7224cf None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:51.843012 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f62b3a-9e15-4356-8d7a-da780a7224cf None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:51.843292 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f62b3a-9e15-4356-8d7a-da780a7224cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:51.850256 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f62b3a-9e15-4356-8d7a-da780a7224cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:51.851729 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f62b3a-9e15-4356-8d7a-da780a7224cf None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:51.864163 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-51f62b3a-9e15-4356-8d7a-da780a7224cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:51.864163 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:51.864163 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:51.864163 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:51.864163 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:51.864163 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:51.864163 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:51.864163 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:51.864163 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:51.864163 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:51.864163 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:51.864163 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:51.864163 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 03:51:51.864163 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 03:51:51.864163 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 03:51:51.866152 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 03:51:51.866152 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:51.866152 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:51.866152 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:51.866152 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:51.866152 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:51.866152 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:51.866152 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:51.866152 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:51.866152 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:51.866152 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:51.866152 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:51.866152 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:51.866152 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:51.866152 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:51.866152 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:51.866152 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:51.868407 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 03:51:51.868407 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 03:51:51.868407 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 03:51:51.868407 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 03:51:51.868407 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 03:51:51.868407 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 03:51:51.868407 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:51.868407 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:51.868407 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 353/690] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:51:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:51.872501 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6fd86-dc4c-4647-8ade-cb4332867d09 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:51.882442 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f62b3a-9e15-4356-8d7a-da780a7224cf None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:51.956128 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:51.995645 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6fd86-dc4c-4647-8ade-cb4332867d09 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:52.004728 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f62b3a-9e15-4356-8d7a-da780a7224cf None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:52.041397 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f0cee-be15-4335-a652-afe9d1cbce95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:52.042650 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f0cee-be15-4335-a652-afe9d1cbce95 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:52.042943 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f0cee-be15-4335-a652-afe9d1cbce95 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:52.043749 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f0cee-be15-4335-a652-afe9d1cbce95 None admin] PATH_INFO: `/v3/projects` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:52.044566 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f0cee-be15-4335-a652-afe9d1cbce95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:52.044878 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f0cee-be15-4335-a652-afe9d1cbce95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:52.046482 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f0cee-be15-4335-a652-afe9d1cbce95 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:52.047596 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb8af7-9e2a-4acb-9025-3bafd5e60d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:52.048345 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb8af7-9e2a-4acb-9025-3bafd5e60d10 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:52.048745 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb8af7-9e2a-4acb-9025-3bafd5e60d10 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:52.049119 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb8af7-9e2a-4acb-9025-3bafd5e60d10 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:52.049796 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb8af7-9e2a-4acb-9025-3bafd5e60d10 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:52.051245 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb8af7-9e2a-4acb-9025-3bafd5e60d10 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:52.063650 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-d6eb8af7-9e2a-4acb-9025-3bafd5e60d10 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 03:51:52.063650 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:52.063650 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 03:51:52.063650 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 03:51:52.063650 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 03:51:52.063650 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 03:51:52.063650 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 03:51:52.063650 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:51:52.063650 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 03:51:52.063650 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:52.063650 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 03:51:52.063650 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:52.063650 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:52.063650 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:52.063650 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:52.063650 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:52.063650 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:52.065425 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:52.065425 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:52.065425 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:52.065425 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:52.065425 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:52.065425 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:52.065425 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 03:51:52.065425 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 03:51:52.065425 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 03:51:52.065425 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 03:51:52.065425 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:52.065425 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:52.065425 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:52.065425 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:52.065425 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:52.065425 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:52.067215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:52.067215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:52.067215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:52.067215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:52.067215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:52.067215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:52.067215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:52.067215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:52.067215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:52.067215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:52.067215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 03:51:52.067215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:51:52.067215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 03:51:52.067215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:52.068904 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 338/691] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 03:51:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:52.068904 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f0cee-be15-4335-a652-afe9d1cbce95 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:52.076538 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 354/692] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Aug 19 03:51:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:52.076538 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb8af7-9e2a-4acb-9025-3bafd5e60d10 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:52.147403 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:52.189473 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb8af7-9e2a-4acb-9025-3bafd5e60d10 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:52.212981 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f0cee-be15-4335-a652-afe9d1cbce95 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:52.221136 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:52.228422 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc0c1f-2261-431d-9c9a-c128e484e52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:52.229197 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc0c1f-2261-431d-9c9a-c128e484e52c None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:52.229573 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc0c1f-2261-431d-9c9a-c128e484e52c None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:52.229966 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc0c1f-2261-431d-9c9a-c128e484e52c None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:52.231302 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc0c1f-2261-431d-9c9a-c128e484e52c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:52.231705 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc0c1f-2261-431d-9c9a-c128e484e52c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:52.233276 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc0c1f-2261-431d-9c9a-c128e484e52c None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:52.243495 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 355/693] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Aug 19 03:51:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:52.244925 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc0c1f-2261-431d-9c9a-c128e484e52c None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:52.262086 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8243932-ae43-4f97-b932-3b62a8e64825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:52.263773 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8243932-ae43-4f97-b932-3b62a8e64825 None admin] REQUEST_METHOD: `PUT` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:52.264475 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8243932-ae43-4f97-b932-3b62a8e64825 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:52.264946 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8243932-ae43-4f97-b932-3b62a8e64825 None admin] PATH_INFO: `/v3/projects/b09192159c884e73bef832a38e2d5e7c/users/7aab3a88f9d0401db32fbaadef2711ee/roles/e154509f216e4ae59f74044aa234ddde` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:52.267672 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8243932-ae43-4f97-b932-3b62a8e64825 None admin] RBAC: Authorizing `identity:create_grant(project_id=b09192159c884e73bef832a38e2d5e7c, user_id=7aab3a88f9d0401db32fbaadef2711ee, role_id=e154509f216e4ae59f74044aa234ddde)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:52.269310 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8243932-ae43-4f97-b932-3b62a8e64825 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:52.295483 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 339/694] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 03:51:52 2022] PUT /identity/v3/projects/b09192159c884e73bef832a38e2d5e7c/users/7aab3a88f9d0401db32fbaadef2711ee/roles/e154509f216e4ae59f74044aa234ddde => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 03:51:52.365149 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc0c1f-2261-431d-9c9a-c128e484e52c None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:52.410751 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01b7b0-3d26-4a3c-9729-a2442fdece03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:52.411380 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01b7b0-3d26-4a3c-9729-a2442fdece03 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:52.411661 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01b7b0-3d26-4a3c-9729-a2442fdece03 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:52.411936 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01b7b0-3d26-4a3c-9729-a2442fdece03 None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:52.412596 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01b7b0-3d26-4a3c-9729-a2442fdece03 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:52.412900 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01b7b0-3d26-4a3c-9729-a2442fdece03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:52.414370 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01b7b0-3d26-4a3c-9729-a2442fdece03 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:52.421559 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 356/695] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Aug 19 03:51:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:52.427631 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8243932-ae43-4f97-b932-3b62a8e64825 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:52.547023 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8243932-ae43-4f97-b932-3b62a8e64825 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:52.567731 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:52.591294 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593d127-d586-4c14-9076-747ddbc65d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:52.592288 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593d127-d586-4c14-9076-747ddbc65d17 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:52.592794 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593d127-d586-4c14-9076-747ddbc65d17 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:52.593267 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593d127-d586-4c14-9076-747ddbc65d17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:52.594255 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593d127-d586-4c14-9076-747ddbc65d17 None admin] RBAC: Adding query filter params (interface=public, service_id=ff44f1d7ca3b45668b885e14a1f8965e, region_id=RegionOne) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:52.594769 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593d127-d586-4c14-9076-747ddbc65d17 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:52.596335 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593d127-d586-4c14-9076-747ddbc65d17 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:52.610658 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 340/696] 10.222.0.43 () {56 vars in 1251 bytes} [Fri Aug 19 03:51:52 2022] GET /identity/v3/endpoints?service_id=ff44f1d7ca3b45668b885e14a1f8965e&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:52.612440 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01b7b0-3d26-4a3c-9729-a2442fdece03 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:52.685387 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:52.730476 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01b7b0-3d26-4a3c-9729-a2442fdece03 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:52.766376 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a98d1-cbcf-41f1-8156-fb1199a12cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:52.767344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a98d1-cbcf-41f1-8156-fb1199a12cd6 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:52.767847 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a98d1-cbcf-41f1-8156-fb1199a12cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:52.768341 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a98d1-cbcf-41f1-8156-fb1199a12cd6 None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:52.769179 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a98d1-cbcf-41f1-8156-fb1199a12cd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:52.771181 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a98d1-cbcf-41f1-8156-fb1199a12cd6 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:52.772068 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff1fc9-096c-4b41-a513-aa0afdccb477 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:52.772971 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff1fc9-096c-4b41-a513-aa0afdccb477 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:52.773492 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff1fc9-096c-4b41-a513-aa0afdccb477 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:52.775292 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 341/697] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 03:51:52.781464 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d3bb4-7f50-4f60-aa6d-d1b9ca76b60f None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:52.782084 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d3bb4-7f50-4f60-aa6d-d1b9ca76b60f None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:52.782570 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d3bb4-7f50-4f60-aa6d-d1b9ca76b60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:52.784681 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 357/698] 10.222.0.43 () {56 vars in 1087 bytes} [Fri Aug 19 03:51:52 2022] GET /identity/v3/services => generated 1002 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 03:51:52.804246 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-fc0d3bb4-7f50-4f60-aa6d-d1b9ca76b60f None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:52.806089 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-fc0d3bb4-7f50-4f60-aa6d-d1b9ca76b60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:52.893011 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 342/699] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:52 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 03:51:52.961087 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b4412-2d7d-4237-b464-669dda40173c None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:52.961996 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b4412-2d7d-4237-b464-669dda40173c None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:52.962453 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b4412-2d7d-4237-b464-669dda40173c None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:52.964472 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 358/700] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:52.969666 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a1c5c-2d4f-4bc4-b5a2-ca1e55292d61 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:52.969951 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a1c5c-2d4f-4bc4-b5a2-ca1e55292d61 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:52.970443 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a1c5c-2d4f-4bc4-b5a2-ca1e55292d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:52.989373 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-159a1c5c-2d4f-4bc4-b5a2-ca1e55292d61 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:52.990867 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-159a1c5c-2d4f-4bc4-b5a2-ca1e55292d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:53.064619 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 343/701] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:52 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 03:51:53.231808 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b4412-2d7d-4237-b464-669dda40173c None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:53.344122 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b4412-2d7d-4237-b464-669dda40173c None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:53.367801 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:53.380253 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9497fb4-9177-48f4-83d8-5cf00309d869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:53.380929 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9497fb4-9177-48f4-83d8-5cf00309d869 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:53.381207 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9497fb4-9177-48f4-83d8-5cf00309d869 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:53.381480 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9497fb4-9177-48f4-83d8-5cf00309d869 None admin] PATH_INFO: `/v3/services/image` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:53.382117 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9497fb4-9177-48f4-83d8-5cf00309d869 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:53.383494 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9497fb4-9177-48f4-83d8-5cf00309d869 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:53.387044 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a1c5c-2d4f-4bc4-b5a2-ca1e55292d61 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:53.396198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-b9497fb4-9177-48f4-83d8-5cf00309d869 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 03:51:53.396198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:53.396198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 03:51:53.396198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 03:51:53.396198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 03:51:53.396198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 03:51:53.396198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 03:51:53.396198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:51:53.396198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 03:51:53.396198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:53.396198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 03:51:53.396198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:53.396198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:53.396198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:53.396198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:53.396198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:53.396198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:53.397254 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:53.397254 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:53.397254 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:53.397254 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:53.397254 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:53.397254 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:53.397254 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 03:51:53.397254 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 03:51:53.397254 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 03:51:53.397254 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 03:51:53.397254 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:53.397254 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:53.397254 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:53.397254 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:53.397254 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:53.397254 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:53.398127 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:53.398127 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:53.398127 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:53.398127 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:53.398127 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:53.398127 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:53.398127 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:53.398127 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:53.398127 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:53.398127 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:53.398127 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 03:51:53.398127 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:51:53.398127 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 03:51:53.398127 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:53.398127 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 359/702] 10.222.0.43 () {56 vars in 1105 bytes} [Fri Aug 19 03:51:53 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:53.405201 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9497fb4-9177-48f4-83d8-5cf00309d869 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:53.453879 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:53.517872 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a1c5c-2d4f-4bc4-b5a2-ca1e55292d61 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:53.539514 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9497fb4-9177-48f4-83d8-5cf00309d869 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:53.567985 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79fbf4-768f-4e69-8f8c-1d464120f28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:53.569073 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79fbf4-768f-4e69-8f8c-1d464120f28d None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:53.569361 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79fbf4-768f-4e69-8f8c-1d464120f28d None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:53.569633 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79fbf4-768f-4e69-8f8c-1d464120f28d None admin] PATH_INFO: `/v3/services/network` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:53.570349 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b79fbf4-768f-4e69-8f8c-1d464120f28d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:53.572189 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b79fbf4-768f-4e69-8f8c-1d464120f28d None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:53.581595 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9261bb-2475-43ef-8a51-761b1fd69a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:53.582459 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9261bb-2475-43ef-8a51-761b1fd69a7f None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:53.582950 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9261bb-2475-43ef-8a51-761b1fd69a7f None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:53.583422 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9261bb-2475-43ef-8a51-761b1fd69a7f None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:53.584012 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-6b79fbf4-768f-4e69-8f8c-1d464120f28d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 03:51:53.584012 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:53.584012 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 03:51:53.584012 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 03:51:53.584012 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 03:51:53.584012 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 03:51:53.584012 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 03:51:53.584012 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:51:53.584012 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 03:51:53.584012 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:53.584012 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 03:51:53.584012 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:53.584012 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:53.584012 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:53.584012 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:53.584012 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:53.584012 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:53.585206 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:53.585206 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:53.585206 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:53.585206 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:53.585206 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:53.585206 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:53.585206 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 03:51:53.585206 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 03:51:53.585206 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 03:51:53.585206 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 03:51:53.585206 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:53.585206 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:53.585206 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:53.585206 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:53.585206 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:53.585206 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:53.586084 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:53.586084 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:53.586084 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:53.586084 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:53.586084 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:53.586084 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:53.586084 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:53.586084 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:53.586084 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:53.586084 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:53.586084 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 03:51:53.586084 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:51:53.586084 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 03:51:53.586084 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:53.586084 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 344/703] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:51:53 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:53.587670 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9261bb-2475-43ef-8a51-761b1fd69a7f None admin] RBAC: Adding query filter params (name=image) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:53.588057 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9261bb-2475-43ef-8a51-761b1fd69a7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:53.590702 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9261bb-2475-43ef-8a51-761b1fd69a7f None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:53.591847 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79fbf4-768f-4e69-8f8c-1d464120f28d None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:53.600564 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 360/704] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:53.602280 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9261bb-2475-43ef-8a51-761b1fd69a7f None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:53.654982 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:53.707148 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9261bb-2475-43ef-8a51-761b1fd69a7f None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:53.710993 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79fbf4-768f-4e69-8f8c-1d464120f28d None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:53.718188 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:53.743611 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc859863-91bb-4bad-a57b-8fc1bf802e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:53.744611 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc859863-91bb-4bad-a57b-8fc1bf802e21 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:53.745223 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc859863-91bb-4bad-a57b-8fc1bf802e21 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:53.746420 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc859863-91bb-4bad-a57b-8fc1bf802e21 None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:53.747388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc859863-91bb-4bad-a57b-8fc1bf802e21 None admin] RBAC: Adding query filter params (type=image) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:53.748023 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc859863-91bb-4bad-a57b-8fc1bf802e21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:53.749290 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf2490-5909-4b6c-b6ad-84dd24380dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:53.749866 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc859863-91bb-4bad-a57b-8fc1bf802e21 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:53.750084 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf2490-5909-4b6c-b6ad-84dd24380dd4 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:53.750451 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf2490-5909-4b6c-b6ad-84dd24380dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:53.750814 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf2490-5909-4b6c-b6ad-84dd24380dd4 None admin] PATH_INFO: `/v3/services` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:53.751714 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf2490-5909-4b6c-b6ad-84dd24380dd4 None admin] RBAC: Adding query filter params (name=network) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:53.752109 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf2490-5909-4b6c-b6ad-84dd24380dd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:53.753708 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf2490-5909-4b6c-b6ad-84dd24380dd4 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:53.760963 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 361/706] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:53 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:53.764344 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 345/706] 10.222.0.43 () {56 vars in 1112 bytes} [Fri Aug 19 03:51:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:53.765152 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc859863-91bb-4bad-a57b-8fc1bf802e21 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:53.766314 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf2490-5909-4b6c-b6ad-84dd24380dd4 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:53.869189 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc859863-91bb-4bad-a57b-8fc1bf802e21 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:53.876251 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf2490-5909-4b6c-b6ad-84dd24380dd4 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:53.885561 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:53.907947 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34184503-0097-4e95-95a0-3332830bff26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:53.908934 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34184503-0097-4e95-95a0-3332830bff26 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:53.909419 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34184503-0097-4e95-95a0-3332830bff26 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:53.909918 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34184503-0097-4e95-95a0-3332830bff26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:53.910808 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34184503-0097-4e95-95a0-3332830bff26 None admin] RBAC: Adding query filter params (interface=public, service_id=ad063fc7c7b1410b970a2d8f791b042c, region_id=RegionOne) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:53.911331 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34184503-0097-4e95-95a0-3332830bff26 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:53.913255 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34184503-0097-4e95-95a0-3332830bff26 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:53.916060 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb6290-1b03-4ef0-9e00-4aacb6fa1e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:53.916709 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb6290-1b03-4ef0-9e00-4aacb6fa1e93 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:53.916984 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb6290-1b03-4ef0-9e00-4aacb6fa1e93 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:53.917255 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb6290-1b03-4ef0-9e00-4aacb6fa1e93 None admin] PATH_INFO: `/v3/services` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:53.917904 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb6290-1b03-4ef0-9e00-4aacb6fa1e93 None admin] RBAC: Adding query filter params (type=network) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:53.918208 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb6290-1b03-4ef0-9e00-4aacb6fa1e93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:53.919542 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb6290-1b03-4ef0-9e00-4aacb6fa1e93 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:53.928084 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 362/708] 10.222.0.43 () {56 vars in 1251 bytes} [Fri Aug 19 03:51:53 2022] GET /identity/v3/endpoints?service_id=ad063fc7c7b1410b970a2d8f791b042c&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:53.928551 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 346/708] 10.222.0.43 () {56 vars in 1112 bytes} [Fri Aug 19 03:51:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:53.930760 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb6290-1b03-4ef0-9e00-4aacb6fa1e93 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:53.931023 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34184503-0097-4e95-95a0-3332830bff26 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:53.970416 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:54.040218 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34184503-0097-4e95-95a0-3332830bff26 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:54.045513 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb6290-1b03-4ef0-9e00-4aacb6fa1e93 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:54.078564 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205f94b-b9a2-4dcd-9ded-ec513b23fde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:54.079560 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205f94b-b9a2-4dcd-9ded-ec513b23fde9 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:54.080117 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205f94b-b9a2-4dcd-9ded-ec513b23fde9 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:54.080636 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205f94b-b9a2-4dcd-9ded-ec513b23fde9 None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:54.081612 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205f94b-b9a2-4dcd-9ded-ec513b23fde9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:54.083436 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205f94b-b9a2-4dcd-9ded-ec513b23fde9 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:54.083711 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ca561-a195-4ba3-b7bf-474ba73d66b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:54.084406 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ca561-a195-4ba3-b7bf-474ba73d66b8 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:54.084944 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ca561-a195-4ba3-b7bf-474ba73d66b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:54.085285 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ca561-a195-4ba3-b7bf-474ba73d66b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:54.086167 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ca561-a195-4ba3-b7bf-474ba73d66b8 None admin] RBAC: Adding query filter params (interface=public, service_id=d55e00fcb6504faeb38c549d9ab63cf1, region_id=RegionOne) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:54.086567 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ca561-a195-4ba3-b7bf-474ba73d66b8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:54.088002 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ca561-a195-4ba3-b7bf-474ba73d66b8 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:54.094987 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 363/710] 10.222.0.43 () {56 vars in 1087 bytes} [Fri Aug 19 03:51:53 2022] GET /identity/v3/services => generated 1002 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 03:51:54.098485 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 347/710] 10.222.0.43 () {56 vars in 1251 bytes} [Fri Aug 19 03:51:53 2022] GET /identity/v3/endpoints?service_id=d55e00fcb6504faeb38c549d9ab63cf1&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:54.099681 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205f94b-b9a2-4dcd-9ded-ec513b23fde9 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:54.156207 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:54.230665 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205f94b-b9a2-4dcd-9ded-ec513b23fde9 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:54.268688 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda01c7-8152-43ff-a9c1-0e0fe66b3581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:54.269303 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda01c7-8152-43ff-a9c1-0e0fe66b3581 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:54.269582 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda01c7-8152-43ff-a9c1-0e0fe66b3581 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:54.269856 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda01c7-8152-43ff-a9c1-0e0fe66b3581 None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:54.270465 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda01c7-8152-43ff-a9c1-0e0fe66b3581 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:54.273032 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda01c7-8152-43ff-a9c1-0e0fe66b3581 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:54.278148 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 364/711] 10.222.0.43 () {56 vars in 1087 bytes} [Fri Aug 19 03:51:54 2022] GET /identity/v3/services => generated 1002 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 03:51:54.640824 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d05be-b6cc-48da-9a5b-d5d76de2d269 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:54.641206 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d05be-b6cc-48da-9a5b-d5d76de2d269 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:54.641411 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d05be-b6cc-48da-9a5b-d5d76de2d269 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:54.643049 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 348/712] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:54.648507 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84686be9-7758-4282-8fd4-f10ad198e8c7 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:54.648807 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84686be9-7758-4282-8fd4-f10ad198e8c7 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:54.649085 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84686be9-7758-4282-8fd4-f10ad198e8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:54.668210 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-84686be9-7758-4282-8fd4-f10ad198e8c7 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:54.669456 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-84686be9-7758-4282-8fd4-f10ad198e8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:54.740273 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 365/713] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:54 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 03:51:55.057445 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae43688-463b-40eb-90f8-36158de9d2ab None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:55.057935 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae43688-463b-40eb-90f8-36158de9d2ab None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:55.057935 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae43688-463b-40eb-90f8-36158de9d2ab None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:55.059645 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 349/714] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:55.065045 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bb1b8-6b7d-437f-949b-c6ce2aef3045 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:55.065445 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bb1b8-6b7d-437f-949b-c6ce2aef3045 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:55.065625 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bb1b8-6b7d-437f-949b-c6ce2aef3045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:55.071084 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae43688-463b-40eb-90f8-36158de9d2ab None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:55.085744 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-157bb1b8-6b7d-437f-949b-c6ce2aef3045 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:55.087200 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-157bb1b8-6b7d-437f-949b-c6ce2aef3045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:55.119073 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:55.178006 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:55.180318 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 366/715] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:55 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 03:51:55.188770 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae43688-463b-40eb-90f8-36158de9d2ab None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:55.226570 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a93b02-c546-4343-b792-03da235d7088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:55.227495 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a93b02-c546-4343-b792-03da235d7088 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:55.227985 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a93b02-c546-4343-b792-03da235d7088 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:55.228464 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a93b02-c546-4343-b792-03da235d7088 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:55.239646 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a93b02-c546-4343-b792-03da235d7088 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:51:55.244601 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-78a93b02-c546-4343-b792-03da235d7088 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:51:55.244601 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:55.244601 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:55.244601 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:55.244601 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:55.244601 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:55.244601 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:55.244601 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:55.244601 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:55.244601 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:55.244601 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:55.244601 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:55.244601 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:51:55.244601 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:51:55.244601 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:51:55.244601 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:51:55.246095 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:51:55.246095 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:51:55.246095 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:51:55.246095 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:51:55.246095 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:55.246095 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:55.246095 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:55.246095 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:55.246095 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:55.246095 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:55.246095 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:55.246095 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:55.246095 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:55.246095 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:55.246095 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:55.246095 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:55.246982 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:55.246982 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:55.246982 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:55.246982 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:55.246982 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:51:55.246982 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:51:55.246982 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:51:55.246982 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:51:55.246982 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:51:55.246982 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:51:55.246982 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:51:55.246982 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:55.253940 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 350/716] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 03:51:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 03:51:55.255437 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bb1b8-6b7d-437f-949b-c6ce2aef3045 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:55.363831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bb1b8-6b7d-437f-949b-c6ce2aef3045 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:55.400362 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d2e96-bb08-49b0-8ff4-73161eeab053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:55.401005 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d2e96-bb08-49b0-8ff4-73161eeab053 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:55.401288 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d2e96-bb08-49b0-8ff4-73161eeab053 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:55.401567 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d2e96-bb08-49b0-8ff4-73161eeab053 None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:55.402269 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d2e96-bb08-49b0-8ff4-73161eeab053 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:55.402574 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d2e96-bb08-49b0-8ff4-73161eeab053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:55.403969 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d2e96-bb08-49b0-8ff4-73161eeab053 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:55.417725 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 367/717] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:51:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:55.423610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a93b02-c546-4343-b792-03da235d7088 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:55.523761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d2e96-bb08-49b0-8ff4-73161eeab053 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:55.535371 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a93b02-c546-4343-b792-03da235d7088 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:55.554365 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:55.572998 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de1c97-f2c2-4c81-9bb8-112d37f0f5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:55.573644 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de1c97-f2c2-4c81-9bb8-112d37f0f5ad None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:55.573983 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de1c97-f2c2-4c81-9bb8-112d37f0f5ad None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:55.574264 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de1c97-f2c2-4c81-9bb8-112d37f0f5ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:55.584648 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de1c97-f2c2-4c81-9bb8-112d37f0f5ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:55.586192 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de1c97-f2c2-4c81-9bb8-112d37f0f5ad None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:55.600831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-42de1c97-f2c2-4c81-9bb8-112d37f0f5ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:55.600831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:55.600831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:55.600831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:55.600831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:55.600831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:55.600831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:55.600831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:55.600831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:55.600831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:55.600831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:55.600831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:55.600831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:55.600831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:55.600831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:55.600831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:55.601840 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:55.601840 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:55.601840 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:55.601840 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:55.601840 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:55.601840 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:55.601840 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:55.601840 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:55.601840 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:55.601840 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:55.601840 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:55.601840 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:55.601840 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:55.601840 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:55.601840 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:55.601840 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:55.601840 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:55.602768 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:55.602768 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:55.602768 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:55.602768 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 351/718] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 03:51:55.608229 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de1c97-f2c2-4c81-9bb8-112d37f0f5ad None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:55.621673 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:55.638218 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d2e96-bb08-49b0-8ff4-73161eeab053 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:55.674246 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1dd60-fe58-432b-b8f2-27d9659c892e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:55.675211 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1dd60-fe58-432b-b8f2-27d9659c892e None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:55.675696 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1dd60-fe58-432b-b8f2-27d9659c892e None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:55.676170 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1dd60-fe58-432b-b8f2-27d9659c892e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:55.677066 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1dd60-fe58-432b-b8f2-27d9659c892e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:55.678690 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1dd60-fe58-432b-b8f2-27d9659c892e None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:55.688349 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-64e1dd60-fe58-432b-b8f2-27d9659c892e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 03:51:55.688349 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:55.688349 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 03:51:55.688349 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 03:51:55.688349 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 03:51:55.688349 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 03:51:55.688349 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 03:51:55.688349 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:51:55.688349 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 03:51:55.688349 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:55.688349 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 03:51:55.688349 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:55.688349 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:55.688349 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:55.688349 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:55.688349 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:55.688349 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:55.689416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:55.689416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:55.689416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:55.689416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:55.689416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:55.689416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:55.689416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 03:51:55.689416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 03:51:55.689416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 03:51:55.689416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 03:51:55.689416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:55.689416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:55.689416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:55.689416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:55.689416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:55.689416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:55.690280 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:55.690280 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:55.690280 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:55.690280 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:55.690280 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:55.690280 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:55.690280 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:55.690280 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:55.690280 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:55.690280 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:55.690280 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 03:51:55.690280 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:51:55.690280 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 03:51:55.690280 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:55.697466 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 368/719] 10.222.0.43 () {56 vars in 1129 bytes} [Fri Aug 19 03:51:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 03:51:55.698598 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1dd60-fe58-432b-b8f2-27d9659c892e None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:55.717285 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de1c97-f2c2-4c81-9bb8-112d37f0f5ad None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:55.753520 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb0ff0-17e8-4860-870a-ee3ecd321e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:55.754195 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb0ff0-17e8-4860-870a-ee3ecd321e37 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:55.754481 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb0ff0-17e8-4860-870a-ee3ecd321e37 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:55.754756 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb0ff0-17e8-4860-870a-ee3ecd321e37 None admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:55.755400 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb0ff0-17e8-4860-870a-ee3ecd321e37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:55.755696 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb0ff0-17e8-4860-870a-ee3ecd321e37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:55.757092 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb0ff0-17e8-4860-870a-ee3ecd321e37 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:55.774225 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 352/720] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:55.775641 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb0ff0-17e8-4860-870a-ee3ecd321e37 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:55.798995 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:55.810498 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1dd60-fe58-432b-b8f2-27d9659c892e None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:55.846184 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ce630-4594-49b5-b1e7-2b034f7209d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:55.847071 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ce630-4594-49b5-b1e7-2b034f7209d2 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:55.847503 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ce630-4594-49b5-b1e7-2b034f7209d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:55.847993 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ce630-4594-49b5-b1e7-2b034f7209d2 None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:55.848867 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ce630-4594-49b5-b1e7-2b034f7209d2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:55.849374 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ce630-4594-49b5-b1e7-2b034f7209d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:55.850683 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:55.851185 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ce630-4594-49b5-b1e7-2b034f7209d2 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:55.861508 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 369/721] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Aug 19 03:51:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:55.862675 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ce630-4594-49b5-b1e7-2b034f7209d2 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:55.886553 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb0ff0-17e8-4860-870a-ee3ecd321e37 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:55.923796 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa604032-41b4-4fd8-94cd-072d3d77fd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:55.924377 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa604032-41b4-4fd8-94cd-072d3d77fd05 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:55.924732 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa604032-41b4-4fd8-94cd-072d3d77fd05 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:55.925014 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa604032-41b4-4fd8-94cd-072d3d77fd05 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:55.932546 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa604032-41b4-4fd8-94cd-072d3d77fd05 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:55.934042 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa604032-41b4-4fd8-94cd-072d3d77fd05 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:55.946069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-aa604032-41b4-4fd8-94cd-072d3d77fd05 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 03:51:55.946069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:55.946069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:55.946069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:55.946069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:55.946069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:55.946069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:55.946069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:55.946069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:55.946069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:55.946069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:55.946069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:55.946069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 03:51:55.946069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 03:51:55.946069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 03:51:55.946069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 03:51:55.947085 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:55.947085 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:55.947085 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 03:51:55.947085 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:55.947085 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 03:51:55.947085 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:51:55.947085 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:55.947085 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:55.947085 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:55.947085 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:55.947085 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:55.947085 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:55.947085 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:55.947085 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:55.947085 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:55.947085 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:55.947085 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:55.947085 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:55.948065 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:55.948065 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:55.948065 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 03:51:55.948065 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 03:51:55.948065 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 03:51:55.948065 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 03:51:55.948065 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 03:51:55.948065 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 03:51:55.948065 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 03:51:55.948065 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:55.952004 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 353/722] 10.222.0.43 () {56 vars in 1093 bytes} [Fri Aug 19 03:51:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 03:51:55.953251 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa604032-41b4-4fd8-94cd-072d3d77fd05 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:55.975463 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ce630-4594-49b5-b1e7-2b034f7209d2 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:56.012126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2558b-546b-4ade-8c65-cede15940a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:56.013380 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2558b-546b-4ade-8c65-cede15940a79 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:56.013887 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2558b-546b-4ade-8c65-cede15940a79 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:56.014366 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2558b-546b-4ade-8c65-cede15940a79 None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:56.015218 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2558b-546b-4ade-8c65-cede15940a79 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:56.015725 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2558b-546b-4ade-8c65-cede15940a79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:56.017352 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2558b-546b-4ade-8c65-cede15940a79 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:56.028318 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 370/723] 10.222.0.43 () {56 vars in 1124 bytes} [Fri Aug 19 03:51:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:56.029537 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2558b-546b-4ade-8c65-cede15940a79 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:56.054426 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:56.062271 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa604032-41b4-4fd8-94cd-072d3d77fd05 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:56.092772 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:56.099964 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33838e4-f0bf-4834-b1bd-d5ce19729192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:56.100594 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33838e4-f0bf-4834-b1bd-d5ce19729192 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:56.100886 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33838e4-f0bf-4834-b1bd-d5ce19729192 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:56.101353 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33838e4-f0bf-4834-b1bd-d5ce19729192 None admin] PATH_INFO: `/v3/users` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:56.101876 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33838e4-f0bf-4834-b1bd-d5ce19729192 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:56.102180 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33838e4-f0bf-4834-b1bd-d5ce19729192 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:56.103682 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33838e4-f0bf-4834-b1bd-d5ce19729192 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:56.127468 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 354/724] 10.222.0.43 () {56 vars in 1133 bytes} [Fri Aug 19 03:51:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:51:56.128759 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33838e4-f0bf-4834-b1bd-d5ce19729192 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:56.143803 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2558b-546b-4ade-8c65-cede15940a79 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:56.182586 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2191e-8b75-4ef5-bdc6-aff904b9a379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:56.183524 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2191e-8b75-4ef5-bdc6-aff904b9a379 None admin] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:56.184023 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2191e-8b75-4ef5-bdc6-aff904b9a379 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:56.184523 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2191e-8b75-4ef5-bdc6-aff904b9a379 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:56.185432 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2191e-8b75-4ef5-bdc6-aff904b9a379 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:56.187009 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2191e-8b75-4ef5-bdc6-aff904b9a379 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:56.219068 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 371/725] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 03:51:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:51:56.249193 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33838e4-f0bf-4834-b1bd-d5ce19729192 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:56.301021 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf0799-beab-4da7-a9da-2e462b1b632d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:56.302013 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf0799-beab-4da7-a9da-2e462b1b632d None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:56.302501 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf0799-beab-4da7-a9da-2e462b1b632d None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:56.302980 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf0799-beab-4da7-a9da-2e462b1b632d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:56.367626 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:56.388990 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf0799-beab-4da7-a9da-2e462b1b632d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:56.390839 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf0799-beab-4da7-a9da-2e462b1b632d None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:56.408616 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13b825-d77a-4bee-8739-8dbc484fe614 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:56.408793 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13b825-d77a-4bee-8739-8dbc484fe614 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:56.409074 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13b825-d77a-4bee-8739-8dbc484fe614 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:56.411434 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 372/726] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:56.416014 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d7905-864c-419d-a4c5-9e3a0696a79b None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:56.416678 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d7905-864c-419d-a4c5-9e3a0696a79b None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:56.417337 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d7905-864c-419d-a4c5-9e3a0696a79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:56.439698 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-ac3d7905-864c-419d-a4c5-9e3a0696a79b None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:56.441976 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-ac3d7905-864c-419d-a4c5-9e3a0696a79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:56.509392 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 355/727] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:51:56 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 03:51:56.516850 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf0799-beab-4da7-a9da-2e462b1b632d None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:56.539054 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 373/728] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:56 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 03:51:56.540452 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a745e-6e15-4abb-a7e3-c38c01d8b383 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:56.540841 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a745e-6e15-4abb-a7e3-c38c01d8b383 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:56.541190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a745e-6e15-4abb-a7e3-c38c01d8b383 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:56.542689 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 374/729] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:56.547747 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c292c-2e53-4df4-bc79-21cc2d8e88b1 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:56.548104 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c292c-2e53-4df4-bc79-21cc2d8e88b1 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:56.548457 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c292c-2e53-4df4-bc79-21cc2d8e88b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:56.568087 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:56.569361 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-a78c292c-2e53-4df4-bc79-21cc2d8e88b1 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:56.571089 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-a78c292c-2e53-4df4-bc79-21cc2d8e88b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:56.617727 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:56.637531 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf0799-beab-4da7-a9da-2e462b1b632d None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:56.672947 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 375/730] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:56 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 03:51:56.681483 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c854b-b4f0-4fea-a382-0bcf6d6e7f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:56.682346 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c854b-b4f0-4fea-a382-0bcf6d6e7f0f None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:56.683433 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c854b-b4f0-4fea-a382-0bcf6d6e7f0f None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:56.684047 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c854b-b4f0-4fea-a382-0bcf6d6e7f0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:56.694977 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c854b-b4f0-4fea-a382-0bcf6d6e7f0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:56.696690 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c854b-b4f0-4fea-a382-0bcf6d6e7f0f None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:56.712678 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-2d3c854b-b4f0-4fea-a382-0bcf6d6e7f0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:56.712678 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:56.712678 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:56.712678 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:56.712678 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:56.712678 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:56.712678 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:56.712678 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:56.712678 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:56.712678 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:56.712678 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:56.712678 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:56.712678 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:51:56.712678 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:51:56.712678 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:51:56.712678 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:51:56.713792 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:56.713792 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:56.713792 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:56.713792 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:56.713792 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:56.713792 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:56.713792 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:56.713792 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:56.713792 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:56.713792 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:56.713792 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:56.713792 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:56.713792 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:56.713792 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:56.713792 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:56.713792 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:56.713792 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:51:56.714753 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:51:56.714753 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:51:56.714753 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:56.716845 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 356/731] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 03:51:56.725422 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c292c-2e53-4df4-bc79-21cc2d8e88b1 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:56.828205 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c292c-2e53-4df4-bc79-21cc2d8e88b1 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:56.862344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf26694-8080-480d-90f9-cd21f5973294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:56.862945 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf26694-8080-480d-90f9-cd21f5973294 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:56.863224 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf26694-8080-480d-90f9-cd21f5973294 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:56.863493 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf26694-8080-480d-90f9-cd21f5973294 None admin] PATH_INFO: `/v3/domains` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:56.864128 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf26694-8080-480d-90f9-cd21f5973294 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:56.864426 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf26694-8080-480d-90f9-cd21f5973294 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:56.865823 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf26694-8080-480d-90f9-cd21f5973294 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:56.872813 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:56.878067 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 376/732] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:56.883295 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c854b-b4f0-4fea-a382-0bcf6d6e7f0f None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:56.892175 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf26694-8080-480d-90f9-cd21f5973294 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:57.010473 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c854b-b4f0-4fea-a382-0bcf6d6e7f0f None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:57.016908 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf26694-8080-480d-90f9-cd21f5973294 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:57.053726 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fdaea-b167-4dc6-b75c-d1ad6c4a54af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:57.054653 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fdaea-b167-4dc6-b75c-d1ad6c4a54af None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:57.054936 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fdaea-b167-4dc6-b75c-d1ad6c4a54af None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:57.055204 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fdaea-b167-4dc6-b75c-d1ad6c4a54af None admin] PATH_INFO: `/v3/projects/service` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:57.058799 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:57.059718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9b668-480e-4ce5-abc9-9d0f233d6737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:57.060378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9b668-480e-4ce5-abc9-9d0f233d6737 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:57.060695 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9b668-480e-4ce5-abc9-9d0f233d6737 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:57.060989 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9b668-480e-4ce5-abc9-9d0f233d6737 None admin] PATH_INFO: `/v3/services/image` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:57.061615 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9b668-480e-4ce5-abc9-9d0f233d6737 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:57.063025 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9b668-480e-4ce5-abc9-9d0f233d6737 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:57.064539 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94fdaea-b167-4dc6-b75c-d1ad6c4a54af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:57.066743 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94fdaea-b167-4dc6-b75c-d1ad6c4a54af None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:57.072316 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-33d9b668-480e-4ce5-abc9-9d0f233d6737 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 03:51:57.072316 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:57.072316 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 03:51:57.072316 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 03:51:57.072316 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 03:51:57.072316 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 03:51:57.072316 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 03:51:57.072316 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:51:57.072316 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 03:51:57.072316 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:57.072316 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 03:51:57.072316 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:57.072316 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:57.072316 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:57.072316 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:57.072316 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:57.072316 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:57.073523 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:57.073523 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:57.073523 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:57.073523 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:57.073523 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:57.073523 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:57.073523 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 03:51:57.073523 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 03:51:57.073523 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 03:51:57.073523 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 03:51:57.073523 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:57.073523 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:57.073523 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:57.073523 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:57.073523 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:57.073523 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:57.074394 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:57.074394 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:57.074394 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:57.074394 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:57.074394 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:57.074394 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:57.074394 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:57.074394 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:57.074394 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:57.074394 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:57.074394 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 03:51:57.074394 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:51:57.074394 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 03:51:57.074394 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:57.074394 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 377/733] 10.222.0.43 () {56 vars in 1105 bytes} [Fri Aug 19 03:51:56 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 03:51:57.075861 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9b668-480e-4ce5-abc9-9d0f233d6737 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:57.083597 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-c94fdaea-b167-4dc6-b75c-d1ad6c4a54af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:57.083597 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:57.083597 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:57.083597 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:57.083597 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:57.083597 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:57.083597 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:57.083597 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:57.083597 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:57.083597 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:57.083597 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:57.083597 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:57.083597 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 03:51:57.083597 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 03:51:57.083597 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 03:51:57.084812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 03:51:57.084812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:57.084812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:57.084812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:57.084812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:57.084812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:57.084812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:57.084812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:57.084812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:57.084812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:57.084812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:57.084812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:57.084812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:57.084812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:57.084812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:57.084812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:57.084812 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:57.085815 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 03:51:57.085815 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 03:51:57.085815 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 03:51:57.085815 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 03:51:57.085815 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 03:51:57.085815 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 03:51:57.085815 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:51:57.085815 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:57.086775 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 357/734] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:51:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:57.087736 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fdaea-b167-4dc6-b75c-d1ad6c4a54af None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:57.141274 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:57.189363 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9b668-480e-4ce5-abc9-9d0f233d6737 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:57.201232 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fdaea-b167-4dc6-b75c-d1ad6c4a54af None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:57.223996 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc0f1a-b712-4c26-a251-a39b0c095c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:57.224650 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc0f1a-b712-4c26-a251-a39b0c095c12 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:57.224937 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc0f1a-b712-4c26-a251-a39b0c095c12 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:57.225205 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc0f1a-b712-4c26-a251-a39b0c095c12 None admin] PATH_INFO: `/v3/services/network` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:57.225774 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc0f1a-b712-4c26-a251-a39b0c095c12 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:57.227154 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc0f1a-b712-4c26-a251-a39b0c095c12 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:57.236932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-b6bc0f1a-b712-4c26-a251-a39b0c095c12 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 03:51:57.236932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:57.236932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 03:51:57.236932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 03:51:57.236932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 03:51:57.236932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 03:51:57.236932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 03:51:57.236932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:51:57.236932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 03:51:57.236932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:57.236932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 03:51:57.236932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:57.236932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:57.236932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:57.236932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:57.236932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:57.236932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:57.238024 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:57.238024 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:57.238024 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:57.238024 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:57.238024 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:57.238024 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:57.238024 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 03:51:57.238024 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 03:51:57.238024 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 03:51:57.238024 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 03:51:57.238024 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:57.238024 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:57.238024 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:57.238024 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:57.238024 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:57.238024 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:57.239378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:57.239378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:57.239378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:57.239378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:57.239378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:57.239378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:57.239378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:57.239378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:57.239378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:57.239378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:57.239378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 03:51:57.239378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:51:57.239378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 03:51:57.239378 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:51:57.240356 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3612ca-24eb-4354-93c8-a5e802aea51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:57.240356 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3612ca-24eb-4354-93c8-a5e802aea51a None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:57.240356 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3612ca-24eb-4354-93c8-a5e802aea51a None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:57.240356 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3612ca-24eb-4354-93c8-a5e802aea51a None admin] PATH_INFO: `/v3/services` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:57.240670 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 378/735] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:51:57 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:57.240670 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc0f1a-b712-4c26-a251-a39b0c095c12 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:57.243537 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3612ca-24eb-4354-93c8-a5e802aea51a None admin] RBAC: Adding query filter params (name=image) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:57.243856 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3612ca-24eb-4354-93c8-a5e802aea51a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:57.245825 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3612ca-24eb-4354-93c8-a5e802aea51a None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:57.252429 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 358/736] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:57.253157 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3612ca-24eb-4354-93c8-a5e802aea51a None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:57.317453 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:57.354263 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc0f1a-b712-4c26-a251-a39b0c095c12 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:57.361851 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3612ca-24eb-4354-93c8-a5e802aea51a None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:57.379926 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:57.392190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f15cc-f816-4e64-9bb7-62239f5361e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:57.392959 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f15cc-f816-4e64-9bb7-62239f5361e9 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:57.393302 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f15cc-f816-4e64-9bb7-62239f5361e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:57.393576 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f15cc-f816-4e64-9bb7-62239f5361e9 None admin] PATH_INFO: `/v3/projects` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:57.394313 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f15cc-f816-4e64-9bb7-62239f5361e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:57.394614 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f15cc-f816-4e64-9bb7-62239f5361e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:57.396109 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f15cc-f816-4e64-9bb7-62239f5361e9 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:57.399691 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ad89b-6fd5-4be7-9cba-2236eb30aadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:57.400658 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ad89b-6fd5-4be7-9cba-2236eb30aadd None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:57.401113 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ad89b-6fd5-4be7-9cba-2236eb30aadd None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:57.402078 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ad89b-6fd5-4be7-9cba-2236eb30aadd None admin] PATH_INFO: `/v3/services` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:57.402877 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ad89b-6fd5-4be7-9cba-2236eb30aadd None admin] RBAC: Adding query filter params (name=network) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:57.403367 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ad89b-6fd5-4be7-9cba-2236eb30aadd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:57.404955 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ad89b-6fd5-4be7-9cba-2236eb30aadd None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:57.415027 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 359/737] 10.222.0.43 () {56 vars in 1112 bytes} [Fri Aug 19 03:51:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:57.415027 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ad89b-6fd5-4be7-9cba-2236eb30aadd None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:57.415410 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 379/738] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 03:51:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:57.416757 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f15cc-f816-4e64-9bb7-62239f5361e9 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:57.524244 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f15cc-f816-4e64-9bb7-62239f5361e9 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:57.529675 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ad89b-6fd5-4be7-9cba-2236eb30aadd None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:57.554884 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:57.563603 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc01928-29f4-4255-b01b-7ac1da0f989b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:57.564259 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc01928-29f4-4255-b01b-7ac1da0f989b None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:57.564648 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc01928-29f4-4255-b01b-7ac1da0f989b None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:57.564987 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc01928-29f4-4255-b01b-7ac1da0f989b None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:57.565610 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc01928-29f4-4255-b01b-7ac1da0f989b None admin] RBAC: Adding query filter params (type=network) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:57.565911 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc01928-29f4-4255-b01b-7ac1da0f989b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:57.567277 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc01928-29f4-4255-b01b-7ac1da0f989b None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:57.567875 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef8e01-efd0-4adb-aa90-36d1db36500b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:57.568702 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef8e01-efd0-4adb-aa90-36d1db36500b None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:57.569049 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef8e01-efd0-4adb-aa90-36d1db36500b None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:57.569636 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef8e01-efd0-4adb-aa90-36d1db36500b None admin] PATH_INFO: `/v3/services` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:57.570262 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef8e01-efd0-4adb-aa90-36d1db36500b None admin] RBAC: Adding query filter params (type=image) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:57.570571 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef8e01-efd0-4adb-aa90-36d1db36500b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:57.571923 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef8e01-efd0-4adb-aa90-36d1db36500b None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:57.577213 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 380/739] 10.222.0.43 () {56 vars in 1112 bytes} [Fri Aug 19 03:51:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:57.577213 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc01928-29f4-4255-b01b-7ac1da0f989b None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:57.581206 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 360/740] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:51:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:57.586364 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef8e01-efd0-4adb-aa90-36d1db36500b None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:57.626036 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:57.679692 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc01928-29f4-4255-b01b-7ac1da0f989b None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:57.693146 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef8e01-efd0-4adb-aa90-36d1db36500b None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:57.721140 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d7ccb-0c2f-4130-b8f0-8212a0edc963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:57.721872 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d7ccb-0c2f-4130-b8f0-8212a0edc963 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:57.722183 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d7ccb-0c2f-4130-b8f0-8212a0edc963 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:57.722524 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d7ccb-0c2f-4130-b8f0-8212a0edc963 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:57.723238 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d7ccb-0c2f-4130-b8f0-8212a0edc963 None admin] RBAC: Adding query filter params (role.id=e154509f216e4ae59f74044aa234ddde, scope.project.id=b09192159c884e73bef832a38e2d5e7c, user.id=7aab3a88f9d0401db32fbaadef2711ee) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:57.723544 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d7ccb-0c2f-4130-b8f0-8212a0edc963 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:57.724999 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d7ccb-0c2f-4130-b8f0-8212a0edc963 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:57.728200 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851248c8-4839-415d-8067-346558e25402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:57.728925 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851248c8-4839-415d-8067-346558e25402 None admin] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:57.729269 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851248c8-4839-415d-8067-346558e25402 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:57.730135 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851248c8-4839-415d-8067-346558e25402 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:57.730850 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851248c8-4839-415d-8067-346558e25402 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:57.740965 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 381/741] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:51:57 2022] GET /identity/v3/role_assignments?user.id=7aab3a88f9d0401db32fbaadef2711ee&scope.project.id=b09192159c884e73bef832a38e2d5e7c&role.id=e154509f216e4ae59f74044aa234ddde => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:57.740965 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d7ccb-0c2f-4130-b8f0-8212a0edc963 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:57.741249 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851248c8-4839-415d-8067-346558e25402 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:57.770971 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 361/742] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 03:51:57 2022] POST /identity/v3/endpoints => generated 337 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:51:57.880659 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d7ccb-0c2f-4130-b8f0-8212a0edc963 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:57.897829 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:57.931041 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269310ab-913a-4bb2-b6c1-f291ac4ae981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:57.931681 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269310ab-913a-4bb2-b6c1-f291ac4ae981 None admin] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:57.931976 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269310ab-913a-4bb2-b6c1-f291ac4ae981 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:57.932344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269310ab-913a-4bb2-b6c1-f291ac4ae981 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:57.933103 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269310ab-913a-4bb2-b6c1-f291ac4ae981 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:57.934649 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269310ab-913a-4bb2-b6c1-f291ac4ae981 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:57.958782 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 382/743] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 03:51:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:51:58.490451 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24e268-320c-4b14-99cd-899ad1285322 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:58.490958 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24e268-320c-4b14-99cd-899ad1285322 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:58.490958 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24e268-320c-4b14-99cd-899ad1285322 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:58.492270 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 362/744] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:51:58.497937 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedb722-ec32-49da-a1e7-df9137d197f4 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:58.498364 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedb722-ec32-49da-a1e7-df9137d197f4 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:58.498662 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedb722-ec32-49da-a1e7-df9137d197f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:58.517179 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-5aedb722-ec32-49da-a1e7-df9137d197f4 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:51:58.518494 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-5aedb722-ec32-49da-a1e7-df9137d197f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:51:58.590715 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 383/745] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:51:58 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 03:51:58.911207 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24e268-320c-4b14-99cd-899ad1285322 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:58.961586 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:59.023872 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24e268-320c-4b14-99cd-899ad1285322 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:59.059098 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ef288-4d9e-4ba8-835d-d83764d5586d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:59.059720 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ef288-4d9e-4ba8-835d-d83764d5586d None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:59.060010 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ef288-4d9e-4ba8-835d-d83764d5586d None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:59.060277 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ef288-4d9e-4ba8-835d-d83764d5586d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:59.060877 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ef288-4d9e-4ba8-835d-d83764d5586d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:59.062240 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ef288-4d9e-4ba8-835d-d83764d5586d None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:59.071218 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-800ef288-4d9e-4ba8-835d-d83764d5586d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 03:51:59.071218 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:59.071218 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 03:51:59.071218 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 03:51:59.071218 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 03:51:59.071218 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 03:51:59.071218 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 03:51:59.071218 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:51:59.071218 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 03:51:59.071218 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:59.071218 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 03:51:59.071218 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:59.071218 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:51:59.071218 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:51:59.071218 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:51:59.071218 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:51:59.071218 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:51:59.072211 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:51:59.072211 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:51:59.072211 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:51:59.072211 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:51:59.072211 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:51:59.072211 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:51:59.072211 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 03:51:59.072211 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 03:51:59.072211 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 03:51:59.072211 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 03:51:59.072211 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:51:59.072211 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:51:59.072211 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:51:59.072211 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:51:59.072211 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:51:59.072211 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:51:59.077604 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:51:59.077604 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:51:59.077604 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:51:59.077604 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:51:59.077604 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:51:59.077604 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:51:59.077604 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:51:59.077604 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:51:59.077604 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:51:59.077604 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:51:59.077604 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 03:51:59.077604 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:51:59.077604 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 03:51:59.077604 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:51:59.077604 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 363/746] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 03:51:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:51:59.078594 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedb722-ec32-49da-a1e7-df9137d197f4 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:59.175196 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:59.187143 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedb722-ec32-49da-a1e7-df9137d197f4 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:59.221473 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb389ed1-57e5-4246-9261-c651094dbf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:59.222068 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb389ed1-57e5-4246-9261-c651094dbf25 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:59.222345 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb389ed1-57e5-4246-9261-c651094dbf25 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:59.222615 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb389ed1-57e5-4246-9261-c651094dbf25 None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:59.223228 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb389ed1-57e5-4246-9261-c651094dbf25 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:59.223524 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb389ed1-57e5-4246-9261-c651094dbf25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:59.224914 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb389ed1-57e5-4246-9261-c651094dbf25 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:59.229680 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 384/747] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 03:51:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:51:59.235001 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ef288-4d9e-4ba8-835d-d83764d5586d None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:51:59.334756 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ef288-4d9e-4ba8-835d-d83764d5586d None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:51:59.344442 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:51:59.369930 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb8515-a06e-4579-95e9-1248baf6abf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:51:59.370529 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb8515-a06e-4579-95e9-1248baf6abf2 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:51:59.370804 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb8515-a06e-4579-95e9-1248baf6abf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:51:59.371073 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb8515-a06e-4579-95e9-1248baf6abf2 None admin] PATH_INFO: `/v3/services` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:51:59.371681 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb8515-a06e-4579-95e9-1248baf6abf2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:51:59.371976 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb8515-a06e-4579-95e9-1248baf6abf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:51:59.373351 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb8515-a06e-4579-95e9-1248baf6abf2 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:51:59.377911 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 364/748] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 03:51:59 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:52:00.016866 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62919b5-71f6-400d-a82f-f70e55d4f531 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:00.017437 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62919b5-71f6-400d-a82f-f70e55d4f531 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:00.017437 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62919b5-71f6-400d-a82f-f70e55d4f531 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:00.018947 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 385/749] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:52:00.024558 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659847c-1874-4b08-bfa1-bc5b4849c09c None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:00.025079 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659847c-1874-4b08-bfa1-bc5b4849c09c None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:00.025079 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659847c-1874-4b08-bfa1-bc5b4849c09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:00.044237 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-0659847c-1874-4b08-bfa1-bc5b4849c09c None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:52:00.045464 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-0659847c-1874-4b08-bfa1-bc5b4849c09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:52:00.116806 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 365/750] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:52:00 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 03:52:00.174616 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aad8ab-5893-4888-a0e1-37cb3c295f09 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:00.174905 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aad8ab-5893-4888-a0e1-37cb3c295f09 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:00.175186 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aad8ab-5893-4888-a0e1-37cb3c295f09 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:00.176713 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 386/751] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:52:00.181651 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dff16-b4d1-43fe-9729-52fcc5ddf63c None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:00.182527 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dff16-b4d1-43fe-9729-52fcc5ddf63c None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:00.182810 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dff16-b4d1-43fe-9729-52fcc5ddf63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:00.200672 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-ac4dff16-b4d1-43fe-9729-52fcc5ddf63c None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:52:00.201858 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-ac4dff16-b4d1-43fe-9729-52fcc5ddf63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:52:00.268451 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 366/752] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:52:00 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 03:52:00.432976 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aad8ab-5893-4888-a0e1-37cb3c295f09 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:00.542041 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aad8ab-5893-4888-a0e1-37cb3c295f09 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:00.574384 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f82df5-7f1a-4435-ac74-a8325ac714bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:00.574999 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f82df5-7f1a-4435-ac74-a8325ac714bd None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:00.575279 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f82df5-7f1a-4435-ac74-a8325ac714bd None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:00.575549 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f82df5-7f1a-4435-ac74-a8325ac714bd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:00.576114 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f82df5-7f1a-4435-ac74-a8325ac714bd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:00.577511 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f82df5-7f1a-4435-ac74-a8325ac714bd None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:00.585903 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-c0f82df5-7f1a-4435-ac74-a8325ac714bd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 03:52:00.585903 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:52:00.585903 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 03:52:00.585903 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 03:52:00.585903 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 03:52:00.585903 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 03:52:00.585903 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 03:52:00.585903 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:52:00.585903 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 03:52:00.585903 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:52:00.585903 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 03:52:00.585903 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:52:00.585903 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:52:00.585903 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:52:00.585903 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:52:00.585903 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:52:00.586857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:52:00.586857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:52:00.586857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:52:00.586857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:52:00.586857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:52:00.586857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:52:00.586857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:52:00.586857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 03:52:00.586857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 03:52:00.586857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 03:52:00.586857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 03:52:00.586857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:52:00.586857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:52:00.586857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:52:00.586857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:52:00.586857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:52:00.586857 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:52:00.587793 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:52:00.587793 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:52:00.587793 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:52:00.587793 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:52:00.587793 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:52:00.587793 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:52:00.587793 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:52:00.587793 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:52:00.587793 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:52:00.587793 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:52:00.587793 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 03:52:00.587793 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:52:00.587793 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 03:52:00.587793 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:52:00.592265 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 387/753] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Aug 19 03:52:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:52:00.592598 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4dff16-b4d1-43fe-9729-52fcc5ddf63c None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:00.592957 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f82df5-7f1a-4435-ac74-a8325ac714bd None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:00.612985 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:00.623277 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:00.694107 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4dff16-b4d1-43fe-9729-52fcc5ddf63c None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:00.701097 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f82df5-7f1a-4435-ac74-a8325ac714bd None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:00.729480 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a90cd7-57dc-4756-821b-63ba39553239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:00.730084 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a90cd7-57dc-4756-821b-63ba39553239 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:00.730365 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a90cd7-57dc-4756-821b-63ba39553239 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:00.730640 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a90cd7-57dc-4756-821b-63ba39553239 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:00.737004 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd110238-ea98-4ee7-8d34-1c7fcd81abbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:00.737603 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd110238-ea98-4ee7-8d34-1c7fcd81abbd None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:00.737878 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd110238-ea98-4ee7-8d34-1c7fcd81abbd None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:00.738147 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd110238-ea98-4ee7-8d34-1c7fcd81abbd None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:00.738886 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd110238-ea98-4ee7-8d34-1c7fcd81abbd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:52:00.739187 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd110238-ea98-4ee7-8d34-1c7fcd81abbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:00.740579 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd110238-ea98-4ee7-8d34-1c7fcd81abbd None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:00.745765 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 388/754] 10.222.0.43 () {56 vars in 1126 bytes} [Fri Aug 19 03:52:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:52:00.751065 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd110238-ea98-4ee7-8d34-1c7fcd81abbd None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:00.800387 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a90cd7-57dc-4756-821b-63ba39553239 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:00.801830 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a90cd7-57dc-4756-821b-63ba39553239 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:00.832498 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:00.840748 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:00.860257 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd110238-ea98-4ee7-8d34-1c7fcd81abbd None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:00.895142 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf7559-57a1-455d-839a-ee12244aca90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:00.895859 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf7559-57a1-455d-839a-ee12244aca90 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:00.896138 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf7559-57a1-455d-839a-ee12244aca90 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:00.896528 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf7559-57a1-455d-839a-ee12244aca90 None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:00.897155 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf7559-57a1-455d-839a-ee12244aca90 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:52:00.897453 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf7559-57a1-455d-839a-ee12244aca90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:00.898807 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf7559-57a1-455d-839a-ee12244aca90 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:00.911377 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 367/755] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:52:00 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 03:52:00.912680 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 389/756] 10.222.0.43 () {56 vars in 1126 bytes} [Fri Aug 19 03:52:00 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:52:00.912906 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a90cd7-57dc-4756-821b-63ba39553239 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:01.018860 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a90cd7-57dc-4756-821b-63ba39553239 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:01.050708 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:01.057566 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff668c34-d4a7-453a-9b9d-191019f449f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:01.058215 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff668c34-d4a7-453a-9b9d-191019f449f2 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:01.058495 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff668c34-d4a7-453a-9b9d-191019f449f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:01.058800 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff668c34-d4a7-453a-9b9d-191019f449f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:01.070106 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff668c34-d4a7-453a-9b9d-191019f449f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:01.071576 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff668c34-d4a7-453a-9b9d-191019f449f2 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:01.088793 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-ff668c34-d4a7-453a-9b9d-191019f449f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:52:01.088793 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:52:01.088793 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:52:01.088793 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:52:01.088793 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:52:01.088793 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:52:01.088793 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:52:01.088793 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:52:01.088793 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:52:01.088793 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:52:01.088793 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:52:01.088793 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:52:01.088793 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:52:01.088793 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:52:01.088793 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:52:01.088793 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:52:01.089818 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:52:01.089818 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:52:01.089818 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:52:01.089818 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:52:01.089818 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:52:01.089818 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:52:01.089818 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:52:01.089818 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:52:01.089818 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:52:01.089818 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:52:01.089818 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:52:01.089818 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:52:01.089818 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:52:01.089818 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:52:01.089818 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:52:01.089818 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:52:01.089818 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:52:01.090755 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:52:01.090755 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:52:01.090755 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:52:01.090755 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 368/757] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:52:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:52:01.095973 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf7559-57a1-455d-839a-ee12244aca90 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:01.207288 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf7559-57a1-455d-839a-ee12244aca90 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:01.240832 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b75c63-70df-433b-a01a-9578d9b4af87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:01.241439 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b75c63-70df-433b-a01a-9578d9b4af87 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:01.241716 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b75c63-70df-433b-a01a-9578d9b4af87 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:01.241986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b75c63-70df-433b-a01a-9578d9b4af87 None admin] PATH_INFO: `/v3/domains` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:01.242616 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b75c63-70df-433b-a01a-9578d9b4af87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:52:01.242971 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b75c63-70df-433b-a01a-9578d9b4af87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:01.244887 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b75c63-70df-433b-a01a-9578d9b4af87 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:01.257002 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 390/758] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:52:01.585339 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ace4b-d567-4be4-99f6-cde929a797d5 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:01.585734 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ace4b-d567-4be4-99f6-cde929a797d5 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:01.586014 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ace4b-d567-4be4-99f6-cde929a797d5 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:01.587348 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 369/759] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:52:01.592750 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc8941-fe8b-4d7b-a42b-5b3b65490ba2 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:01.593033 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc8941-fe8b-4d7b-a42b-5b3b65490ba2 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:01.593304 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc8941-fe8b-4d7b-a42b-5b3b65490ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:01.606103 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:01.612093 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-d0dc8941-fe8b-4d7b-a42b-5b3b65490ba2 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:52:01.613297 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-d0dc8941-fe8b-4d7b-a42b-5b3b65490ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:52:01.679055 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 391/760] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:52:01 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 03:52:02.005207 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ace4b-d567-4be4-99f6-cde929a797d5 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:02.110258 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ace4b-d567-4be4-99f6-cde929a797d5 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:02.142199 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d128e-0d85-4eb5-8041-3340cb152b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:02.142796 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d128e-0d85-4eb5-8041-3340cb152b48 None admin] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:02.143074 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d128e-0d85-4eb5-8041-3340cb152b48 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:02.143347 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d128e-0d85-4eb5-8041-3340cb152b48 None admin] PATH_INFO: `/v3/services` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:02.143981 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d128e-0d85-4eb5-8041-3340cb152b48 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:02.145372 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d128e-0d85-4eb5-8041-3340cb152b48 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:02.160134 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 370/761] 10.222.0.43 () {60 vars in 1141 bytes} [Fri Aug 19 03:52:02 2022] POST /identity/v3/services => generated 251 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:52:03.106826 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdeecb1-f926-4640-a7a6-707afafc5478 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:03.107385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdeecb1-f926-4640-a7a6-707afafc5478 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:03.107385 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdeecb1-f926-4640-a7a6-707afafc5478 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:03.108758 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 392/762] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:52:03.114037 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f09174-4b78-46d8-ad1a-7b8007a9ba64 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:03.114436 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f09174-4b78-46d8-ad1a-7b8007a9ba64 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:03.114574 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f09174-4b78-46d8-ad1a-7b8007a9ba64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:03.132961 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-87f09174-4b78-46d8-ad1a-7b8007a9ba64 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:52:03.134123 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-87f09174-4b78-46d8-ad1a-7b8007a9ba64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:52:03.176801 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:03.210991 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 371/763] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:52:03 2022] POST /identity/v3/auth/tokens => generated 1507 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 03:52:03.541657 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdeecb1-f926-4640-a7a6-707afafc5478 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:03.640216 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdeecb1-f926-4640-a7a6-707afafc5478 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:03.673237 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357124a3-8d90-42f2-aa34-f0f56c56ba42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:03.673837 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357124a3-8d90-42f2-aa34-f0f56c56ba42 None admin] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:03.674118 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357124a3-8d90-42f2-aa34-f0f56c56ba42 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:03.674392 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357124a3-8d90-42f2-aa34-f0f56c56ba42 None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:03.675026 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357124a3-8d90-42f2-aa34-f0f56c56ba42 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:03.676402 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357124a3-8d90-42f2-aa34-f0f56c56ba42 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:03.680612 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:03.693443 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 393/764] 10.222.0.43 () {60 vars in 1141 bytes} [Fri Aug 19 03:52:03 2022] POST /identity/v3/services => generated 269 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:52:04.326217 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c7507-9e77-44a7-8196-3cd3d40965cf None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:04.326764 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c7507-9e77-44a7-8196-3cd3d40965cf None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:04.326764 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c7507-9e77-44a7-8196-3cd3d40965cf None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:04.328078 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 372/765] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:52:04.333401 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116accb-8580-4b78-a43d-c13bd7092b21 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:04.333803 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116accb-8580-4b78-a43d-c13bd7092b21 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:04.333953 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116accb-8580-4b78-a43d-c13bd7092b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:04.351886 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-2116accb-8580-4b78-a43d-c13bd7092b21 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:52:04.353714 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-2116accb-8580-4b78-a43d-c13bd7092b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:52:04.422734 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 394/766] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:52:04 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 03:52:04.744894 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c7507-9e77-44a7-8196-3cd3d40965cf None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:04.848751 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c7507-9e77-44a7-8196-3cd3d40965cf None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:04.881719 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262e136-44a8-4b93-86d7-03440fb041ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:04.882342 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262e136-44a8-4b93-86d7-03440fb041ae None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:04.882619 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262e136-44a8-4b93-86d7-03440fb041ae None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:04.882891 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262e136-44a8-4b93-86d7-03440fb041ae None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:04.883459 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262e136-44a8-4b93-86d7-03440fb041ae None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:04.885419 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262e136-44a8-4b93-86d7-03440fb041ae None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:04.894154 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-9262e136-44a8-4b93-86d7-03440fb041ae None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 03:52:04.894154 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:52:04.894154 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 03:52:04.894154 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 03:52:04.894154 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 03:52:04.894154 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 03:52:04.894154 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 03:52:04.894154 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:52:04.894154 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 03:52:04.894154 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:52:04.894154 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 03:52:04.894154 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:52:04.894154 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:52:04.894154 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:52:04.894154 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:52:04.894154 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:52:04.894154 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:52:04.896610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:52:04.896610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:52:04.896610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:52:04.896610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:52:04.896610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:52:04.896610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:52:04.896610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 03:52:04.896610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 03:52:04.896610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 03:52:04.896610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 03:52:04.896610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:52:04.896610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:52:04.896610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:52:04.896610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:52:04.896610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:52:04.896610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:52:04.897524 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:52:04.897524 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:52:04.897524 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:52:04.897524 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:52:04.897524 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:52:04.897524 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:52:04.897524 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:52:04.897524 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:52:04.897524 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:52:04.897524 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:52:04.897524 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 03:52:04.897524 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:52:04.897524 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 03:52:04.897524 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:52:04.897524 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 373/767] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 03:52:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:52:04.901116 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116accb-8580-4b78-a43d-c13bd7092b21 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:04.995766 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116accb-8580-4b78-a43d-c13bd7092b21 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:05.018334 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:05.030095 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6b8a3-be27-4119-aa4a-b5f2ff722437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:05.030700 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6b8a3-be27-4119-aa4a-b5f2ff722437 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:05.030980 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6b8a3-be27-4119-aa4a-b5f2ff722437 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:05.031255 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6b8a3-be27-4119-aa4a-b5f2ff722437 None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:05.031975 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6b8a3-be27-4119-aa4a-b5f2ff722437 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:52:05.032271 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6b8a3-be27-4119-aa4a-b5f2ff722437 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:05.033682 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6b8a3-be27-4119-aa4a-b5f2ff722437 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:05.038180 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 395/768] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 03:52:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:52:05.044079 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262e136-44a8-4b93-86d7-03440fb041ae None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:05.078558 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:05.143149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262e136-44a8-4b93-86d7-03440fb041ae None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:05.176172 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a47032-be7e-4bae-8fa5-96bad9945077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:05.176816 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a47032-be7e-4bae-8fa5-96bad9945077 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:05.177096 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a47032-be7e-4bae-8fa5-96bad9945077 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:05.177371 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a47032-be7e-4bae-8fa5-96bad9945077 None admin] PATH_INFO: `/v3/services` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:05.177993 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a47032-be7e-4bae-8fa5-96bad9945077 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:52:05.178294 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a47032-be7e-4bae-8fa5-96bad9945077 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:05.179655 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a47032-be7e-4bae-8fa5-96bad9945077 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:05.184917 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 374/769] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 03:52:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:52:05.191082 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6b8a3-be27-4119-aa4a-b5f2ff722437 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:05.287035 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6b8a3-be27-4119-aa4a-b5f2ff722437 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:05.320259 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79f217-879a-42cf-97d6-790a0f1b5eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:05.320898 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79f217-879a-42cf-97d6-790a0f1b5eec None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:05.321179 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79f217-879a-42cf-97d6-790a0f1b5eec None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:05.321479 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79f217-879a-42cf-97d6-790a0f1b5eec None admin] PATH_INFO: `/v3/endpoints` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:05.322166 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79f217-879a-42cf-97d6-790a0f1b5eec None admin] RBAC: Adding query filter params (interface=public, service_id=1d1e6c5b63204e39ac08d1175f0c6383, region_id=RegionOne) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:52:05.322470 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79f217-879a-42cf-97d6-790a0f1b5eec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:05.323829 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79f217-879a-42cf-97d6-790a0f1b5eec None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:05.328662 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 396/770] 10.222.0.43 () {56 vars in 1251 bytes} [Fri Aug 19 03:52:05 2022] GET /identity/v3/endpoints?service_id=1d1e6c5b63204e39ac08d1175f0c6383&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:52:05.334219 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a47032-be7e-4bae-8fa5-96bad9945077 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:05.428870 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:05.433109 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a47032-be7e-4bae-8fa5-96bad9945077 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:05.465832 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e97f0-9f9c-40e3-8a01-e5a6509dd103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:05.466430 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e97f0-9f9c-40e3-8a01-e5a6509dd103 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:05.466709 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e97f0-9f9c-40e3-8a01-e5a6509dd103 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:05.466983 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e97f0-9f9c-40e3-8a01-e5a6509dd103 None admin] PATH_INFO: `/v3/services` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:05.467577 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e97f0-9f9c-40e3-8a01-e5a6509dd103 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:05.468976 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e97f0-9f9c-40e3-8a01-e5a6509dd103 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:05.474874 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 375/771] 10.222.0.43 () {56 vars in 1087 bytes} [Fri Aug 19 03:52:05 2022] GET /identity/v3/services => generated 1498 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 03:52:05.850736 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681c18b-af02-4f2b-9c5c-00913db9cbe5 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:05.851261 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681c18b-af02-4f2b-9c5c-00913db9cbe5 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:05.851261 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681c18b-af02-4f2b-9c5c-00913db9cbe5 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:05.853316 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 397/772] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:52:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:52:05.858404 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d4fb3-7de9-41e7-825f-3fd9bb947978 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:05.858687 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d4fb3-7de9-41e7-825f-3fd9bb947978 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:05.858965 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d4fb3-7de9-41e7-825f-3fd9bb947978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:05.876413 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-010d4fb3-7de9-41e7-825f-3fd9bb947978 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:52:05.877609 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-010d4fb3-7de9-41e7-825f-3fd9bb947978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:52:05.942441 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 376/773] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:52:05 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 03:52:06.268326 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681c18b-af02-4f2b-9c5c-00913db9cbe5 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:06.318012 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:06.367471 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681c18b-af02-4f2b-9c5c-00913db9cbe5 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:06.400935 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd7057-0453-42ac-9385-f37159fa06fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:06.401564 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd7057-0453-42ac-9385-f37159fa06fe None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:06.401847 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd7057-0453-42ac-9385-f37159fa06fe None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:06.402123 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd7057-0453-42ac-9385-f37159fa06fe None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:06.402694 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd7057-0453-42ac-9385-f37159fa06fe None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:06.404062 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd7057-0453-42ac-9385-f37159fa06fe None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:06.412719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-60dd7057-0453-42ac-9385-f37159fa06fe None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 03:52:06.412719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:52:06.412719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 03:52:06.412719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 03:52:06.412719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 03:52:06.412719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 03:52:06.412719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 03:52:06.412719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:52:06.412719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 03:52:06.412719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:52:06.412719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 03:52:06.412719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:52:06.412719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:52:06.412719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:52:06.412719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:52:06.412719 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:52:06.413690 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:52:06.413690 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:52:06.413690 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:52:06.413690 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:52:06.413690 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:52:06.413690 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:52:06.413690 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:52:06.413690 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 03:52:06.413690 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 03:52:06.413690 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 03:52:06.413690 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 03:52:06.413690 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:52:06.413690 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:52:06.413690 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:52:06.413690 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:52:06.413690 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:52:06.413690 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:52:06.414607 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:52:06.414607 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:52:06.414607 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:52:06.414607 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:52:06.414607 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:52:06.414607 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:52:06.414607 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:52:06.414607 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:52:06.414607 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:52:06.414607 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:52:06.414607 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 03:52:06.414607 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:52:06.414607 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 03:52:06.414607 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:52:06.414607 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 398/774] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Aug 19 03:52:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:52:06.419732 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d4fb3-7de9-41e7-825f-3fd9bb947978 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:06.508333 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:06.518020 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d4fb3-7de9-41e7-825f-3fd9bb947978 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:06.554533 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85f390-0430-473f-a11f-8c32f2cf0ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:06.555166 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85f390-0430-473f-a11f-8c32f2cf0ccb None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:06.555959 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85f390-0430-473f-a11f-8c32f2cf0ccb None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:06.556231 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85f390-0430-473f-a11f-8c32f2cf0ccb None admin] PATH_INFO: `/v3/services` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:06.556907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85f390-0430-473f-a11f-8c32f2cf0ccb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:52:06.557212 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85f390-0430-473f-a11f-8c32f2cf0ccb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:06.558606 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85f390-0430-473f-a11f-8c32f2cf0ccb None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:06.563767 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 377/775] 10.222.0.43 () {56 vars in 1126 bytes} [Fri Aug 19 03:52:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:52:06.569581 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd7057-0453-42ac-9385-f37159fa06fe None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:06.665556 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd7057-0453-42ac-9385-f37159fa06fe None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:06.678394 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:06.699201 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01116ef9-347f-40d6-86a1-0424cd630f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:06.699795 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01116ef9-347f-40d6-86a1-0424cd630f6e None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:06.700071 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01116ef9-347f-40d6-86a1-0424cd630f6e None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:06.700341 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01116ef9-347f-40d6-86a1-0424cd630f6e None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:06.700987 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01116ef9-347f-40d6-86a1-0424cd630f6e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:52:06.701285 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01116ef9-347f-40d6-86a1-0424cd630f6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:06.702646 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01116ef9-347f-40d6-86a1-0424cd630f6e None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:06.707508 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 399/776] 10.222.0.43 () {56 vars in 1126 bytes} [Fri Aug 19 03:52:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:52:06.713484 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85f390-0430-473f-a11f-8c32f2cf0ccb None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:06.811921 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85f390-0430-473f-a11f-8c32f2cf0ccb None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:06.844471 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ecfd4-b64b-4126-a9f5-885b3c76955a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:06.845113 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ecfd4-b64b-4126-a9f5-885b3c76955a None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:06.845389 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ecfd4-b64b-4126-a9f5-885b3c76955a None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:06.845661 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ecfd4-b64b-4126-a9f5-885b3c76955a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:06.846345 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ecfd4-b64b-4126-a9f5-885b3c76955a None admin] RBAC: Adding query filter params (interface=public, service_id=b27815ef8c444e46a539d0cf804e128a, region_id=RegionOne) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:52:06.846648 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ecfd4-b64b-4126-a9f5-885b3c76955a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:06.847996 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ecfd4-b64b-4126-a9f5-885b3c76955a None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:06.853397 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 378/777] 10.222.0.43 () {56 vars in 1251 bytes} [Fri Aug 19 03:52:06 2022] GET /identity/v3/endpoints?service_id=b27815ef8c444e46a539d0cf804e128a&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:52:06.858934 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01116ef9-347f-40d6-86a1-0424cd630f6e None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:06.956581 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01116ef9-347f-40d6-86a1-0424cd630f6e None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:06.988837 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc57af8-3944-435d-a3db-52c43b6c6aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:06.989435 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc57af8-3944-435d-a3db-52c43b6c6aea None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:06.989715 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc57af8-3944-435d-a3db-52c43b6c6aea None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:06.989994 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc57af8-3944-435d-a3db-52c43b6c6aea None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:06.990591 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc57af8-3944-435d-a3db-52c43b6c6aea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:06.991962 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc57af8-3944-435d-a3db-52c43b6c6aea None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:06.998357 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 400/778] 10.222.0.43 () {56 vars in 1087 bytes} [Fri Aug 19 03:52:06 2022] GET /identity/v3/services => generated 1498 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 03:52:07.644186 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b107f-3fec-403d-8214-b19544a91c2b None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:07.644769 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b107f-3fec-403d-8214-b19544a91c2b None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:07.644769 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b107f-3fec-403d-8214-b19544a91c2b None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:07.646082 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 379/779] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:52:07.652024 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691a3a6-791c-4086-b260-4b1e1f168e54 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:07.652379 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691a3a6-791c-4086-b260-4b1e1f168e54 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:07.652761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691a3a6-791c-4086-b260-4b1e1f168e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:07.790363 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-5691a3a6-791c-4086-b260-4b1e1f168e54 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:52:07.791557 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-5691a3a6-791c-4086-b260-4b1e1f168e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:52:07.829859 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:07.860323 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 401/780] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:52:07 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 03:52:08.183406 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b107f-3fec-403d-8214-b19544a91c2b None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:08.205282 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:08.282741 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b107f-3fec-403d-8214-b19544a91c2b None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:08.315564 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7dc4e3-0d72-4eb1-8936-976d9569a6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:08.316175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dc4e3-0d72-4eb1-8936-976d9569a6f6 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:08.316449 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dc4e3-0d72-4eb1-8936-976d9569a6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:08.316823 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dc4e3-0d72-4eb1-8936-976d9569a6f6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:08.317388 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7dc4e3-0d72-4eb1-8936-976d9569a6f6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:08.318735 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7dc4e3-0d72-4eb1-8936-976d9569a6f6 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:08.327193 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-7d7dc4e3-0d72-4eb1-8936-976d9569a6f6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 03:52:08.327193 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:52:08.327193 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 03:52:08.327193 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 03:52:08.327193 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 03:52:08.327193 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 03:52:08.327193 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 03:52:08.327193 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:52:08.327193 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 03:52:08.327193 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:52:08.327193 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 03:52:08.327193 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:52:08.327193 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:52:08.327193 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:52:08.327193 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:52:08.327193 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:52:08.327193 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:52:08.328296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:52:08.328296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:52:08.328296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:52:08.328296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:52:08.328296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:52:08.328296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:52:08.328296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 03:52:08.328296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 03:52:08.328296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 03:52:08.328296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 03:52:08.328296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:52:08.328296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:52:08.328296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:52:08.328296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:52:08.328296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:52:08.328296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:52:08.329610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:52:08.329610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:52:08.329610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:52:08.329610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:52:08.329610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:52:08.329610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:52:08.329610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:52:08.329610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:52:08.329610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:52:08.329610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:52:08.329610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 03:52:08.329610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:52:08.329610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 03:52:08.329610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:52:08.329610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 380/781] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 03:52:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:52:08.334136 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691a3a6-791c-4086-b260-4b1e1f168e54 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:08.428140 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691a3a6-791c-4086-b260-4b1e1f168e54 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:08.460748 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b87cd6-b5bc-41db-a7be-301e9e7c90d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:08.461347 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b87cd6-b5bc-41db-a7be-301e9e7c90d2 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:08.461624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b87cd6-b5bc-41db-a7be-301e9e7c90d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:08.461895 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b87cd6-b5bc-41db-a7be-301e9e7c90d2 None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:08.462508 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b87cd6-b5bc-41db-a7be-301e9e7c90d2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:52:08.462804 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b87cd6-b5bc-41db-a7be-301e9e7c90d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:08.464175 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b87cd6-b5bc-41db-a7be-301e9e7c90d2 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:08.468679 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 402/782] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 03:52:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:52:08.474380 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7dc4e3-0d72-4eb1-8936-976d9569a6f6 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:08.560743 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:08.576599 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7dc4e3-0d72-4eb1-8936-976d9569a6f6 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:08.609090 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ededc25-0f12-42f8-aaf0-edc4ea59dd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:08.609689 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ededc25-0f12-42f8-aaf0-edc4ea59dd59 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:08.609968 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ededc25-0f12-42f8-aaf0-edc4ea59dd59 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:08.610240 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ededc25-0f12-42f8-aaf0-edc4ea59dd59 None admin] PATH_INFO: `/v3/services` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:08.610859 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ededc25-0f12-42f8-aaf0-edc4ea59dd59 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:52:08.611159 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ededc25-0f12-42f8-aaf0-edc4ea59dd59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:08.612546 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ededc25-0f12-42f8-aaf0-edc4ea59dd59 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:08.617227 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 381/783] 10.222.0.43 () {56 vars in 1114 bytes} [Fri Aug 19 03:52:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:52:08.623534 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b87cd6-b5bc-41db-a7be-301e9e7c90d2 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:08.657460 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:08.719653 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b87cd6-b5bc-41db-a7be-301e9e7c90d2 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:08.758988 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e714ee6-98ee-4109-adf3-a0fba90f0c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:08.759644 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e714ee6-98ee-4109-adf3-a0fba90f0c95 None admin] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:08.759923 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e714ee6-98ee-4109-adf3-a0fba90f0c95 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:08.760191 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e714ee6-98ee-4109-adf3-a0fba90f0c95 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:08.761124 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e714ee6-98ee-4109-adf3-a0fba90f0c95 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:08.762481 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e714ee6-98ee-4109-adf3-a0fba90f0c95 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:08.792510 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 403/784] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 03:52:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:52:09.174304 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c975f8-5aee-40d8-873c-76d45ebbc236 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:09.174692 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c975f8-5aee-40d8-873c-76d45ebbc236 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:09.174890 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c975f8-5aee-40d8-873c-76d45ebbc236 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:09.176228 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 382/785] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:52:09.181636 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5ff1b-00b0-4512-b9df-560645326c81 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:09.182066 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5ff1b-00b0-4512-b9df-560645326c81 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:09.182314 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5ff1b-00b0-4512-b9df-560645326c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:09.200505 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-96a5ff1b-00b0-4512-b9df-560645326c81 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:52:09.201699 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-96a5ff1b-00b0-4512-b9df-560645326c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:52:09.278516 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 404/786] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:52:09 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 03:52:09.600810 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c975f8-5aee-40d8-873c-76d45ebbc236 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:09.699851 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c975f8-5aee-40d8-873c-76d45ebbc236 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:09.732742 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5eda2-0a62-4204-8877-43ec9e5930ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:09.733362 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5eda2-0a62-4204-8877-43ec9e5930ca None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:09.733641 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5eda2-0a62-4204-8877-43ec9e5930ca None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:09.733915 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5eda2-0a62-4204-8877-43ec9e5930ca None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:09.734480 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5eda2-0a62-4204-8877-43ec9e5930ca None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:09.735836 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5eda2-0a62-4204-8877-43ec9e5930ca None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:09.744298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-73c5eda2-0a62-4204-8877-43ec9e5930ca None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 03:52:09.744298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:52:09.744298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 03:52:09.744298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 03:52:09.744298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 03:52:09.744298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 03:52:09.744298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 03:52:09.744298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:52:09.744298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 03:52:09.744298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:52:09.744298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 03:52:09.744298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:52:09.744298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:52:09.744298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:52:09.744298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:52:09.744298 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:52:09.745276 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:52:09.745276 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:52:09.745276 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:52:09.745276 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:52:09.745276 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:52:09.745276 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:52:09.745276 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:52:09.745276 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 03:52:09.745276 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 03:52:09.745276 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 03:52:09.745276 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 03:52:09.745276 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:52:09.745276 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:52:09.745276 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:52:09.745276 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:52:09.745276 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:52:09.745276 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:52:09.746185 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:52:09.746185 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:52:09.746185 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:52:09.746185 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:52:09.746185 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:52:09.746185 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:52:09.746185 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:52:09.746185 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:52:09.746185 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:52:09.746185 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:52:09.746185 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 03:52:09.746185 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:52:09.746185 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 03:52:09.746185 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:52:09.746185 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 383/787] 10.222.0.43 () {56 vars in 1132 bytes} [Fri Aug 19 03:52:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:52:09.751215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5ff1b-00b0-4512-b9df-560645326c81 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:09.769705 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:09.851534 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5ff1b-00b0-4512-b9df-560645326c81 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:09.884298 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d47fd6-9be3-42b9-8736-136fa905bf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:09.884950 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d47fd6-9be3-42b9-8736-136fa905bf8f None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:09.885482 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d47fd6-9be3-42b9-8736-136fa905bf8f None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:09.885755 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d47fd6-9be3-42b9-8736-136fa905bf8f None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:09.886394 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d47fd6-9be3-42b9-8736-136fa905bf8f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:52:09.886695 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d47fd6-9be3-42b9-8736-136fa905bf8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:09.888104 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d47fd6-9be3-42b9-8736-136fa905bf8f None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:09.893616 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 405/788] 10.222.0.43 () {56 vars in 1126 bytes} [Fri Aug 19 03:52:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:52:09.899905 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5eda2-0a62-4204-8877-43ec9e5930ca None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:09.915165 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:09.998201 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5eda2-0a62-4204-8877-43ec9e5930ca None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:10.032247 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e147aa-da8d-46d5-85f1-81f259f53ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:10.032914 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e147aa-da8d-46d5-85f1-81f259f53ee2 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:10.033191 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e147aa-da8d-46d5-85f1-81f259f53ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:10.033465 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e147aa-da8d-46d5-85f1-81f259f53ee2 None admin] PATH_INFO: `/v3/services` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:10.034083 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e147aa-da8d-46d5-85f1-81f259f53ee2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:52:10.034382 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e147aa-da8d-46d5-85f1-81f259f53ee2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:10.035743 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e147aa-da8d-46d5-85f1-81f259f53ee2 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:10.040620 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 384/789] 10.222.0.43 () {56 vars in 1126 bytes} [Fri Aug 19 03:52:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:52:10.046271 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d47fd6-9be3-42b9-8736-136fa905bf8f None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:10.125725 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:10.145143 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d47fd6-9be3-42b9-8736-136fa905bf8f None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:10.183311 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523e735-ccc9-4672-a46e-444c825b284f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:10.183921 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523e735-ccc9-4672-a46e-444c825b284f None admin] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:10.184200 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523e735-ccc9-4672-a46e-444c825b284f None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:10.184474 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523e735-ccc9-4672-a46e-444c825b284f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:10.185148 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523e735-ccc9-4672-a46e-444c825b284f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:10.186518 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523e735-ccc9-4672-a46e-444c825b284f None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:10.205945 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 406/790] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 03:52:10 2022] POST /identity/v3/endpoints => generated 347 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:52:10.976168 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b131b8c-b40b-4613-88df-8324acaa6c03 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:10.977313 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b131b8c-b40b-4613-88df-8324acaa6c03 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:10.977313 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b131b8c-b40b-4613-88df-8324acaa6c03 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:10.978601 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 385/791] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:52:10.983877 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73b12f-a361-496e-a683-3406784c9328 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:10.984163 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73b12f-a361-496e-a683-3406784c9328 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:10.984436 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73b12f-a361-496e-a683-3406784c9328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:11.002368 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-2a73b12f-a361-496e-a683-3406784c9328 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:52:11.003531 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-2a73b12f-a361-496e-a683-3406784c9328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:52:11.073177 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 407/792] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:52:10 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 03:52:11.406086 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b131b8c-b40b-4613-88df-8324acaa6c03 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:11.484474 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:11.509710 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b131b8c-b40b-4613-88df-8324acaa6c03 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:11.543230 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4236eb-7df3-4e54-a515-37374aa601fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:11.543825 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4236eb-7df3-4e54-a515-37374aa601fc None admin] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:11.544104 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4236eb-7df3-4e54-a515-37374aa601fc None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:11.544397 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4236eb-7df3-4e54-a515-37374aa601fc None admin] PATH_INFO: `/v3/projects` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:11.545030 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4236eb-7df3-4e54-a515-37374aa601fc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:11.546454 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4236eb-7df3-4e54-a515-37374aa601fc None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:11.549035 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: WARNING keystone.server.flask.common [None req-ec4236eb-7df3-4e54-a515-37374aa601fc None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 19 03:52:11.570745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.sql.core [None req-ec4236eb-7df3-4e54-a515-37374aa601fc None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 03:52:11.570745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 19 03:52:11.570745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [parameters: {'id': 'f6b425d2981f431a87899100c73ed287', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 19 03:52:11.570745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88198) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 03:52:11.587214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-ec4236eb-7df3-4e54-a515-37374aa601fc None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f6b425d2981f431a87899100c73ed287.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f6b425d2981f431a87899100c73ed287. Aug 19 03:52:11.587214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:52:11.587214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 03:52:11.587214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 03:52:11.587214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 03:52:11.587214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 03:52:11.587214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 03:52:11.587214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 03:52:11.587214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 03:52:11.587214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application conn.query(q) Aug 19 03:52:11.587214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 03:52:11.587214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 03:52:11.587214 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 03:52:11.588190 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application result.read() Aug 19 03:52:11.588190 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 03:52:11.588190 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 03:52:11.588190 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 03:52:11.588190 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 03:52:11.588190 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 03:52:11.588190 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 03:52:11.588190 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 03:52:11.588190 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 03:52:11.588190 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 03:52:11.588190 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:52:11.588190 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 03:52:11.588190 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:52:11.588190 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:52:11.588190 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 03:52:11.588190 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 03:52:11.588190 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 19 03:52:11.588190 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 19 03:52:11.589657 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 03:52:11.589657 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application next(self.gen) Aug 19 03:52:11.589657 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 03:52:11.589657 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application yield resource Aug 19 03:52:11.589657 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 03:52:11.589657 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application next(self.gen) Aug 19 03:52:11.589657 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 03:52:11.589657 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 03:52:11.589657 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 03:52:11.589657 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 03:52:11.589657 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 03:52:11.589657 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise self.value Aug 19 03:52:11.589657 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 03:52:11.589657 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 03:52:11.589657 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 03:52:11.589657 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application session.commit() Aug 19 03:52:11.589657 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 03:52:11.590679 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 03:52:11.590679 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 03:52:11.590679 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 03:52:11.590679 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 03:52:11.590679 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self.session.flush() Aug 19 03:52:11.590679 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 03:52:11.590679 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 03:52:11.590679 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 03:52:11.590679 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 03:52:11.590679 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 03:52:11.590679 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application compat.raise_( Aug 19 03:52:11.590679 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 03:52:11.590679 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception Aug 19 03:52:11.590679 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 03:52:11.590679 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 03:52:11.590679 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 03:52:11.590679 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 03:52:11.591623 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 03:52:11.591623 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 03:52:11.591623 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 03:52:11.591623 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 03:52:11.591623 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 19 03:52:11.591623 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 19 03:52:11.591623 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 03:52:11.591623 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 03:52:11.591623 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 03:52:11.591623 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 03:52:11.591623 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 03:52:11.591623 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 03:52:11.591623 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 03:52:11.591623 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 03:52:11.591623 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 03:52:11.592474 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 03:52:11.592474 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 03:52:11.592474 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception Aug 19 03:52:11.592474 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 03:52:11.592474 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 03:52:11.592474 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 03:52:11.592474 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 03:52:11.592474 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 03:52:11.592474 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 03:52:11.592474 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 03:52:11.592474 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application conn.query(q) Aug 19 03:52:11.592474 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 03:52:11.592474 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 03:52:11.592474 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 03:52:11.592474 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application result.read() Aug 19 03:52:11.592474 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 03:52:11.592474 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 03:52:11.594216 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 03:52:11.594216 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 03:52:11.594216 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 03:52:11.594216 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 03:52:11.594216 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 03:52:11.594216 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 03:52:11.594216 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 03:52:11.594216 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 19 03:52:11.594216 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [parameters: {'id': 'f6b425d2981f431a87899100c73ed287', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 19 03:52:11.594216 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 03:52:11.594216 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:52:11.594216 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 03:52:11.594216 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:52:11.594216 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:52:11.594216 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 19 03:52:11.595197 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 19 03:52:11.595197 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 03:52:11.595197 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 03:52:11.595197 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 19 03:52:11.595197 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:52:11.595197 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 03:52:11.595197 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:52:11.595197 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:52:11.595197 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:52:11.595197 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:52:11.595197 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:52:11.595197 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:52:11.595197 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:52:11.595197 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:52:11.595197 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:52:11.595197 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:52:11.595197 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:52:11.596661 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:52:11.596661 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 19 03:52:11.596661 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 19 03:52:11.596661 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:52:11.596661 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:52:11.596661 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 19 03:52:11.596661 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 19 03:52:11.596661 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f6b425d2981f431a87899100c73ed287. Aug 19 03:52:11.596661 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:52:11.596661 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 386/793] 10.222.0.43 () {60 vars in 1140 bytes} [Fri Aug 19 03:52:11 2022] POST /identity/v3/projects => generated 262 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:52:11.598283 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73b12f-a361-496e-a683-3406784c9328 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:11.655628 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:11.693207 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73b12f-a361-496e-a683-3406784c9328 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:11.725107 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ecb36-72b4-4c61-adc8-c131ecf37698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:11.725722 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ecb36-72b4-4c61-adc8-c131ecf37698 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:11.725995 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ecb36-72b4-4c61-adc8-c131ecf37698 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:11.726847 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ecb36-72b4-4c61-adc8-c131ecf37698 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:11.733174 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ecb36-72b4-4c61-adc8-c131ecf37698 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:11.734598 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ecb36-72b4-4c61-adc8-c131ecf37698 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:11.745150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-e20ecb36-72b4-4c61-adc8-c131ecf37698 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:52:11.745150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:52:11.745150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:52:11.745150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:52:11.745150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:52:11.745150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:52:11.745150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:52:11.745150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:52:11.745150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:52:11.745150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:52:11.745150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:52:11.745150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:52:11.745150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 03:52:11.745150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 03:52:11.745150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 03:52:11.746104 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 03:52:11.746104 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:52:11.746104 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:52:11.746104 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:52:11.746104 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:52:11.746104 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:52:11.746104 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:52:11.746104 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:52:11.746104 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:52:11.746104 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:52:11.746104 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:52:11.746104 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:52:11.746104 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:52:11.746104 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:52:11.746104 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:52:11.746104 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:52:11.746104 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:52:11.747348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 03:52:11.747348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 03:52:11.747348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 03:52:11.747348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 03:52:11.747348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 03:52:11.747348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 03:52:11.747348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:52:11.747348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:52:11.747348 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 408/794] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:52:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:52:11.752279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4236eb-7df3-4e54-a515-37374aa601fc None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:11.853013 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4236eb-7df3-4e54-a515-37374aa601fc None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:11.880749 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:11.886716 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4090e0-b583-4124-83af-306a6b0cd77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:11.887383 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4090e0-b583-4124-83af-306a6b0cd77e None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:11.887675 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4090e0-b583-4124-83af-306a6b0cd77e None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:11.888188 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4090e0-b583-4124-83af-306a6b0cd77e None admin] PATH_INFO: `/v3/projects` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:11.889092 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4090e0-b583-4124-83af-306a6b0cd77e None admin] RBAC: Adding query filter params (name=service) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:52:11.889624 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4090e0-b583-4124-83af-306a6b0cd77e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:11.891436 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4090e0-b583-4124-83af-306a6b0cd77e None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:11.911850 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 387/795] 10.222.0.43 () {56 vars in 1112 bytes} [Fri Aug 19 03:52:11 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:52:12.384346 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ef87e-6799-42eb-8664-948cabf8fb33 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:12.384904 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ef87e-6799-42eb-8664-948cabf8fb33 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:12.385185 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ef87e-6799-42eb-8664-948cabf8fb33 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:12.386503 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 409/796] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:52:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:52:12.391671 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f0614-d6a5-4f99-bab3-5df1c7232828 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:12.392128 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f0614-d6a5-4f99-bab3-5df1c7232828 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:12.392350 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f0614-d6a5-4f99-bab3-5df1c7232828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:12.412248 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-070f0614-d6a5-4f99-bab3-5df1c7232828 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:52:12.414091 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-070f0614-d6a5-4f99-bab3-5df1c7232828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:52:12.483970 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 388/797] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:52:12 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 03:52:12.811939 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ef87e-6799-42eb-8664-948cabf8fb33 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:12.909453 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ef87e-6799-42eb-8664-948cabf8fb33 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:12.932238 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:12.942969 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622db47b-2577-4a0f-91bf-dcacd7823779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:12.943619 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622db47b-2577-4a0f-91bf-dcacd7823779 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:12.943895 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622db47b-2577-4a0f-91bf-dcacd7823779 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:12.944166 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622db47b-2577-4a0f-91bf-dcacd7823779 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:12.944794 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622db47b-2577-4a0f-91bf-dcacd7823779 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:12.946161 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622db47b-2577-4a0f-91bf-dcacd7823779 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:12.954655 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-622db47b-2577-4a0f-91bf-dcacd7823779 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 03:52:12.954655 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:52:12.954655 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 03:52:12.954655 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 03:52:12.954655 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 03:52:12.954655 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 03:52:12.954655 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 03:52:12.954655 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:52:12.954655 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 03:52:12.954655 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:52:12.954655 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 03:52:12.954655 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:52:12.954655 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:52:12.954655 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:52:12.954655 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:52:12.954655 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:52:12.954655 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:52:12.955831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:52:12.955831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:52:12.955831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:52:12.955831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:52:12.955831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:52:12.955831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:52:12.955831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 03:52:12.955831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 03:52:12.955831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 03:52:12.955831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 03:52:12.955831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:52:12.955831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:52:12.955831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:52:12.955831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:52:12.955831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:52:12.955831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:52:12.956743 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:52:12.956743 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:52:12.956743 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:52:12.956743 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:52:12.956743 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:52:12.956743 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:52:12.956743 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:52:12.956743 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:52:12.956743 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:52:12.956743 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:52:12.956743 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 03:52:12.956743 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:52:12.956743 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 03:52:12.956743 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:52:12.956743 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 410/798] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:52:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:52:12.962267 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f0614-d6a5-4f99-bab3-5df1c7232828 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:13.060819 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f0614-d6a5-4f99-bab3-5df1c7232828 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:13.082837 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:13.094200 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e49c7-8996-48eb-8623-2da5c97fd0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:13.094800 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e49c7-8996-48eb-8623-2da5c97fd0eb None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:13.095076 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e49c7-8996-48eb-8623-2da5c97fd0eb None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:13.095348 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e49c7-8996-48eb-8623-2da5c97fd0eb None admin] PATH_INFO: `/v3/services` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:13.095964 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e49c7-8996-48eb-8623-2da5c97fd0eb None admin] RBAC: Adding query filter params (name=compute) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:52:13.096266 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e49c7-8996-48eb-8623-2da5c97fd0eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:13.097665 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e49c7-8996-48eb-8623-2da5c97fd0eb None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:13.102740 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 389/799] 10.222.0.43 () {56 vars in 1112 bytes} [Fri Aug 19 03:52:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:52:13.109060 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622db47b-2577-4a0f-91bf-dcacd7823779 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:13.209875 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622db47b-2577-4a0f-91bf-dcacd7823779 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:13.243951 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee99e53-f927-4ac1-a896-3f7d608293a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:13.244605 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee99e53-f927-4ac1-a896-3f7d608293a4 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:13.244891 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee99e53-f927-4ac1-a896-3f7d608293a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:13.245167 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee99e53-f927-4ac1-a896-3f7d608293a4 None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:13.245786 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee99e53-f927-4ac1-a896-3f7d608293a4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:52:13.246094 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee99e53-f927-4ac1-a896-3f7d608293a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:13.247457 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee99e53-f927-4ac1-a896-3f7d608293a4 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:13.251733 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 411/800] 10.222.0.43 () {56 vars in 1112 bytes} [Fri Aug 19 03:52:13 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:52:14.117704 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768a9a7-2743-4375-8d2d-5fa2868a3fe9 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:14.118227 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768a9a7-2743-4375-8d2d-5fa2868a3fe9 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:14.118227 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768a9a7-2743-4375-8d2d-5fa2868a3fe9 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:14.119561 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 390/801] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:52:14.124663 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b8c7e-80dd-4a33-a666-f64092039864 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:14.125048 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b8c7e-80dd-4a33-a666-f64092039864 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:14.125218 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b8c7e-80dd-4a33-a666-f64092039864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:14.147029 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-be4b8c7e-80dd-4a33-a666-f64092039864 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:52:14.148207 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-be4b8c7e-80dd-4a33-a666-f64092039864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:52:14.199617 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:14.219357 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 412/802] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:52:14 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 03:52:14.545512 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768a9a7-2743-4375-8d2d-5fa2868a3fe9 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:14.646420 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768a9a7-2743-4375-8d2d-5fa2868a3fe9 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:14.680099 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75545e-a2fc-4e44-83e9-4580ad8139a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:14.680728 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75545e-a2fc-4e44-83e9-4580ad8139a6 None admin] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:14.681005 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75545e-a2fc-4e44-83e9-4580ad8139a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:14.681273 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75545e-a2fc-4e44-83e9-4580ad8139a6 None admin] PATH_INFO: `/v3/users` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:14.681904 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75545e-a2fc-4e44-83e9-4580ad8139a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:14.683320 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75545e-a2fc-4e44-83e9-4580ad8139a6 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:14.696943 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.sql.core [None req-8a75545e-a2fc-4e44-83e9-4580ad8139a6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 03:52:14.696943 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 19 03:52:14.696943 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [parameters: {'user_id': '8fcc7131d986475f833e07874638060b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 19 03:52:14.696943 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88198) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 03:52:14.705494 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-8a75545e-a2fc-4e44-83e9-4580ad8139a6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 19 03:52:14.705494 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:52:14.705494 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 03:52:14.705494 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 03:52:14.705494 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 03:52:14.705494 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 03:52:14.705494 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 03:52:14.705494 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 03:52:14.705494 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 03:52:14.705494 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application conn.query(q) Aug 19 03:52:14.705494 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 03:52:14.705494 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 03:52:14.705494 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 03:52:14.705494 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application result.read() Aug 19 03:52:14.705494 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 03:52:14.706554 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 03:52:14.706554 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 03:52:14.706554 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 03:52:14.706554 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 03:52:14.706554 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 03:52:14.706554 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 03:52:14.706554 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 03:52:14.706554 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 03:52:14.706554 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:52:14.706554 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 03:52:14.706554 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:52:14.706554 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:52:14.706554 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 03:52:14.706554 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 03:52:14.706554 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 19 03:52:14.706554 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 19 03:52:14.706554 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 03:52:14.706554 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application next(self.gen) Aug 19 03:52:14.707575 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 03:52:14.707575 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application yield resource Aug 19 03:52:14.707575 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 03:52:14.707575 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application next(self.gen) Aug 19 03:52:14.707575 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 03:52:14.707575 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 03:52:14.707575 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 03:52:14.707575 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 03:52:14.707575 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 03:52:14.707575 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise self.value Aug 19 03:52:14.707575 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 03:52:14.707575 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 03:52:14.707575 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 03:52:14.707575 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application session.commit() Aug 19 03:52:14.707575 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 03:52:14.707575 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 03:52:14.707575 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 03:52:14.708464 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 03:52:14.708464 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 03:52:14.708464 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self.session.flush() Aug 19 03:52:14.708464 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 03:52:14.708464 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 03:52:14.708464 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 03:52:14.708464 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 03:52:14.708464 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 03:52:14.708464 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application compat.raise_( Aug 19 03:52:14.708464 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 03:52:14.708464 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception Aug 19 03:52:14.708464 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 03:52:14.708464 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 03:52:14.708464 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 03:52:14.708464 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 03:52:14.708464 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 03:52:14.708464 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 03:52:14.709673 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 03:52:14.709673 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 03:52:14.709673 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 19 03:52:14.709673 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 19 03:52:14.709673 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 03:52:14.709673 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 03:52:14.709673 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 03:52:14.709673 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 03:52:14.709673 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 03:52:14.709673 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 03:52:14.709673 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 03:52:14.709673 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 03:52:14.709673 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 03:52:14.709673 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 03:52:14.709673 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 03:52:14.709673 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception Aug 19 03:52:14.711433 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 03:52:14.711433 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 03:52:14.711433 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 03:52:14.711433 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 03:52:14.711433 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 03:52:14.711433 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 03:52:14.711433 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 03:52:14.711433 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application conn.query(q) Aug 19 03:52:14.711433 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 03:52:14.711433 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 03:52:14.711433 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 03:52:14.711433 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application result.read() Aug 19 03:52:14.711433 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 03:52:14.711433 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 03:52:14.711433 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 03:52:14.711433 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 03:52:14.712716 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 03:52:14.712716 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 03:52:14.712716 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 03:52:14.712716 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 03:52:14.712716 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 03:52:14.712716 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 19 03:52:14.712716 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [parameters: {'user_id': '8fcc7131d986475f833e07874638060b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 19 03:52:14.712716 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 03:52:14.712716 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:52:14.712716 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 03:52:14.712716 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:52:14.712716 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:52:14.712716 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:52:14.712716 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:52:14.712716 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:52:14.713790 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:52:14.713790 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:52:14.713790 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:52:14.713790 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:52:14.713790 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:52:14.713790 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:52:14.713790 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:52:14.713790 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 19 03:52:14.713790 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 19 03:52:14.713790 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:52:14.713790 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:52:14.713790 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 03:52:14.713790 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:52:14.713790 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 03:52:14.713790 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:52:14.713790 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 19 03:52:14.713790 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 19 03:52:14.714951 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 19 03:52:14.714951 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 19 03:52:14.714951 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 03:52:14.714951 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 03:52:14.714951 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 19 03:52:14.714951 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:52:14.714951 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 391/803] 10.222.0.43 () {60 vars in 1131 bytes} [Fri Aug 19 03:52:14 2022] POST /identity/v3/users => generated 160 bytes in 162 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:52:14.715646 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b8c7e-80dd-4a33-a666-f64092039864 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:14.812064 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b8c7e-80dd-4a33-a666-f64092039864 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:14.845134 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee2f48-0d13-47ba-9739-92a997ed5e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:14.845754 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee2f48-0d13-47ba-9739-92a997ed5e69 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:14.846027 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee2f48-0d13-47ba-9739-92a997ed5e69 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:14.846298 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee2f48-0d13-47ba-9739-92a997ed5e69 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:14.854062 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee2f48-0d13-47ba-9739-92a997ed5e69 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:14.855479 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee2f48-0d13-47ba-9739-92a997ed5e69 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:14.866538 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-8fee2f48-0d13-47ba-9739-92a997ed5e69 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 03:52:14.866538 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:52:14.866538 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:52:14.866538 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:52:14.866538 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:52:14.866538 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:52:14.866538 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:52:14.866538 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:52:14.866538 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:52:14.866538 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:52:14.866538 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:52:14.866538 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:52:14.866538 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 03:52:14.866538 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 03:52:14.866538 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 03:52:14.866538 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 03:52:14.867718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:52:14.867718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:52:14.867718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 03:52:14.867718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:52:14.867718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 03:52:14.867718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:52:14.867718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:52:14.867718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:52:14.867718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:52:14.867718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:52:14.867718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:52:14.867718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:52:14.867718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:52:14.867718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:52:14.867718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:52:14.867718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:52:14.867718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:52:14.867718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:52:14.868838 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:52:14.868838 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:52:14.868838 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 03:52:14.868838 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 03:52:14.868838 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 03:52:14.868838 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 03:52:14.868838 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 03:52:14.868838 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 03:52:14.868838 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 03:52:14.868838 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:52:14.868838 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 413/804] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:52:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:52:14.873546 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75545e-a2fc-4e44-83e9-4580ad8139a6 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:14.922037 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:14.972500 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75545e-a2fc-4e44-83e9-4580ad8139a6 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:15.005372 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bad2e-0c34-4bc9-8024-12aeedbf13e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:15.005969 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bad2e-0c34-4bc9-8024-12aeedbf13e4 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:15.006243 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bad2e-0c34-4bc9-8024-12aeedbf13e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:15.006510 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bad2e-0c34-4bc9-8024-12aeedbf13e4 None admin] PATH_INFO: `/v3/users` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:15.007719 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bad2e-0c34-4bc9-8024-12aeedbf13e4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:52:15.008011 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bad2e-0c34-4bc9-8024-12aeedbf13e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:15.009927 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bad2e-0c34-4bc9-8024-12aeedbf13e4 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:15.046504 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 392/805] 10.222.0.43 () {56 vars in 1101 bytes} [Fri Aug 19 03:52:14 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:52:15.405571 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5f4b3-9ad6-48a0-ac67-dfc969569ce3 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:15.406108 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5f4b3-9ad6-48a0-ac67-dfc969569ce3 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:15.406108 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5f4b3-9ad6-48a0-ac67-dfc969569ce3 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:15.407452 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 414/806] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:52:15.412708 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4bbca-f7df-4da6-81aa-c6834471766a None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:15.413151 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4bbca-f7df-4da6-81aa-c6834471766a None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:15.413306 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4bbca-f7df-4da6-81aa-c6834471766a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:15.432008 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-4ab4bbca-f7df-4da6-81aa-c6834471766a None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:52:15.433479 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-4ab4bbca-f7df-4da6-81aa-c6834471766a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:52:15.496574 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 393/807] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:52:15 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 03:52:15.819760 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5f4b3-9ad6-48a0-ac67-dfc969569ce3 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:15.862485 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:15.917926 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5f4b3-9ad6-48a0-ac67-dfc969569ce3 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:15.949711 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3f9a6-07a1-409b-b54a-49359b998e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:15.950304 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3f9a6-07a1-409b-b54a-49359b998e68 None admin] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:15.950582 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3f9a6-07a1-409b-b54a-49359b998e68 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:15.950856 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3f9a6-07a1-409b-b54a-49359b998e68 None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:15.951496 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3f9a6-07a1-409b-b54a-49359b998e68 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:15.952888 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3f9a6-07a1-409b-b54a-49359b998e68 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:15.966349 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 415/808] 10.222.0.43 () {60 vars in 1141 bytes} [Fri Aug 19 03:52:15 2022] POST /identity/v3/services => generated 242 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:52:18.139184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b27d8-5500-4395-8e73-0f731a86e2fb None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:18.139705 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b27d8-5500-4395-8e73-0f731a86e2fb None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:18.139811 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b27d8-5500-4395-8e73-0f731a86e2fb None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:18.141104 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 394/809] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:52:18.146292 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ba752-dfdd-4ed2-b8fd-f1fc88e13edf None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:18.147236 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ba752-dfdd-4ed2-b8fd-f1fc88e13edf None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:18.147460 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ba752-dfdd-4ed2-b8fd-f1fc88e13edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:18.165091 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-bf4ba752-dfdd-4ed2-b8fd-f1fc88e13edf None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:52:18.166286 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-bf4ba752-dfdd-4ed2-b8fd-f1fc88e13edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:52:18.236802 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 416/810] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:52:18 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 03:52:18.559558 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b27d8-5500-4395-8e73-0f731a86e2fb None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:18.594533 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:18.658807 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b27d8-5500-4395-8e73-0f731a86e2fb None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:18.691392 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a77a2c-08c3-4a48-b7d8-eff68e877088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:18.692003 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a77a2c-08c3-4a48-b7d8-eff68e877088 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:18.692282 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a77a2c-08c3-4a48-b7d8-eff68e877088 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:18.692578 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a77a2c-08c3-4a48-b7d8-eff68e877088 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:18.693146 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a77a2c-08c3-4a48-b7d8-eff68e877088 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:18.695122 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a77a2c-08c3-4a48-b7d8-eff68e877088 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:18.703590 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-35a77a2c-08c3-4a48-b7d8-eff68e877088 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 03:52:18.703590 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:52:18.703590 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 03:52:18.703590 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 03:52:18.703590 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 03:52:18.703590 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 03:52:18.703590 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 03:52:18.703590 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:52:18.703590 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 03:52:18.703590 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:52:18.703590 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 03:52:18.703590 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:52:18.703590 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:52:18.703590 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:52:18.703590 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:52:18.703590 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:52:18.703590 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:52:18.704764 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:52:18.704764 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:52:18.704764 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:52:18.704764 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:52:18.704764 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:52:18.704764 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:52:18.704764 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 03:52:18.704764 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 03:52:18.704764 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 03:52:18.704764 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 03:52:18.704764 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:52:18.704764 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:52:18.704764 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:52:18.704764 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:52:18.704764 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:52:18.704764 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:52:18.705814 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:52:18.705814 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:52:18.705814 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:52:18.705814 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:52:18.705814 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:52:18.705814 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:52:18.705814 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:52:18.705814 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:52:18.705814 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:52:18.705814 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:52:18.705814 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 03:52:18.705814 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:52:18.705814 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 03:52:18.705814 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:52:18.705814 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 395/811] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:52:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:52:18.710787 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ba752-dfdd-4ed2-b8fd-f1fc88e13edf None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:18.737259 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:18.807341 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ba752-dfdd-4ed2-b8fd-f1fc88e13edf None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:18.839391 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0262db8-f4a3-4b96-bf96-c841dff37d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:18.839918 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0262db8-f4a3-4b96-bf96-c841dff37d15 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:18.840194 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0262db8-f4a3-4b96-bf96-c841dff37d15 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:18.840461 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0262db8-f4a3-4b96-bf96-c841dff37d15 None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:18.841100 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0262db8-f4a3-4b96-bf96-c841dff37d15 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:52:18.841397 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0262db8-f4a3-4b96-bf96-c841dff37d15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:18.842749 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0262db8-f4a3-4b96-bf96-c841dff37d15 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:18.847270 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 417/812] 10.222.0.43 () {56 vars in 1112 bytes} [Fri Aug 19 03:52:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:52:18.853447 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a77a2c-08c3-4a48-b7d8-eff68e877088 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:18.947309 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:18.950206 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a77a2c-08c3-4a48-b7d8-eff68e877088 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:18.983423 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4d403-3211-46c5-a0ef-8d53cd8247e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:18.984012 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4d403-3211-46c5-a0ef-8d53cd8247e9 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:18.984295 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4d403-3211-46c5-a0ef-8d53cd8247e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:18.984603 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4d403-3211-46c5-a0ef-8d53cd8247e9 None admin] PATH_INFO: `/v3/services` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:18.985219 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4d403-3211-46c5-a0ef-8d53cd8247e9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:52:18.985521 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4d403-3211-46c5-a0ef-8d53cd8247e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:18.986868 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4d403-3211-46c5-a0ef-8d53cd8247e9 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:18.992122 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 396/813] 10.222.0.43 () {56 vars in 1112 bytes} [Fri Aug 19 03:52:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:52:18.997984 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0262db8-f4a3-4b96-bf96-c841dff37d15 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:19.084536 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:19.093099 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0262db8-f4a3-4b96-bf96-c841dff37d15 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:19.126010 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e796d-1a00-4bd8-b94d-4fc8a3fcc9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:19.126598 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e796d-1a00-4bd8-b94d-4fc8a3fcc9e4 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:19.126872 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e796d-1a00-4bd8-b94d-4fc8a3fcc9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:19.127141 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e796d-1a00-4bd8-b94d-4fc8a3fcc9e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:19.127818 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e796d-1a00-4bd8-b94d-4fc8a3fcc9e4 None admin] RBAC: Adding query filter params (interface=public, service_id=13e8c8a0b1694de98ab47323656515e4, region_id=RegionOne) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:52:19.128120 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e796d-1a00-4bd8-b94d-4fc8a3fcc9e4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:19.129504 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e796d-1a00-4bd8-b94d-4fc8a3fcc9e4 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:19.134493 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 418/814] 10.222.0.43 () {56 vars in 1251 bytes} [Fri Aug 19 03:52:18 2022] GET /identity/v3/endpoints?service_id=13e8c8a0b1694de98ab47323656515e4&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:52:19.139937 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4d403-3211-46c5-a0ef-8d53cd8247e9 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:19.237869 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4d403-3211-46c5-a0ef-8d53cd8247e9 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:19.269965 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5aca8-93b6-4237-8f19-01dc87da6b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:19.270555 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5aca8-93b6-4237-8f19-01dc87da6b93 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:19.270832 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5aca8-93b6-4237-8f19-01dc87da6b93 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:19.271105 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5aca8-93b6-4237-8f19-01dc87da6b93 None admin] PATH_INFO: `/v3/services` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:19.272234 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5aca8-93b6-4237-8f19-01dc87da6b93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:19.273618 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5aca8-93b6-4237-8f19-01dc87da6b93 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:19.279532 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 397/815] 10.222.0.43 () {56 vars in 1087 bytes} [Fri Aug 19 03:52:19 2022] GET /identity/v3/services => generated 1728 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 03:52:21.445697 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b576e2-6e93-40fe-aa7a-bea92aebc989 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:21.446190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b576e2-6e93-40fe-aa7a-bea92aebc989 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:21.446190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b576e2-6e93-40fe-aa7a-bea92aebc989 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:21.447497 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 419/816] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:52:21.452794 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdf644-e8ae-4e7d-80a8-825710d04407 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:21.453190 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdf644-e8ae-4e7d-80a8-825710d04407 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:21.453337 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdf644-e8ae-4e7d-80a8-825710d04407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:21.470719 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-b0fdf644-e8ae-4e7d-80a8-825710d04407 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:52:21.471878 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-b0fdf644-e8ae-4e7d-80a8-825710d04407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:52:21.493927 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:21.536404 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 398/817] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:52:21 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 03:52:21.862959 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b576e2-6e93-40fe-aa7a-bea92aebc989 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:21.959239 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b576e2-6e93-40fe-aa7a-bea92aebc989 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:21.992851 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b2326-266d-45fa-aa2f-ab3c59088ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:21.993467 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b2326-266d-45fa-aa2f-ab3c59088ea8 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:21.993744 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b2326-266d-45fa-aa2f-ab3c59088ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:21.994017 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b2326-266d-45fa-aa2f-ab3c59088ea8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:21.994581 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b2326-266d-45fa-aa2f-ab3c59088ea8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:21.995933 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b2326-266d-45fa-aa2f-ab3c59088ea8 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:22.004262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-5c2b2326-266d-45fa-aa2f-ab3c59088ea8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 03:52:22.004262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:52:22.004262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 03:52:22.004262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 03:52:22.004262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 03:52:22.004262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 03:52:22.004262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 03:52:22.004262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:52:22.004262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 03:52:22.004262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:52:22.004262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 03:52:22.004262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:52:22.004262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:52:22.004262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:52:22.004262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:52:22.004262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:52:22.004262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:52:22.008760 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:52:22.008760 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:52:22.008760 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:52:22.008760 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:52:22.008760 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:52:22.008760 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:52:22.008760 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 03:52:22.008760 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 03:52:22.008760 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 03:52:22.008760 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 03:52:22.008760 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:52:22.008760 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:52:22.008760 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:52:22.008760 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:52:22.008760 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:52:22.008760 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:52:22.009847 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:52:22.009847 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:52:22.009847 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:52:22.009847 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:52:22.009847 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:52:22.009847 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:52:22.009847 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:52:22.009847 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:52:22.009847 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:52:22.009847 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:52:22.009847 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 03:52:22.009847 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:52:22.009847 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 03:52:22.009847 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:52:22.009847 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 420/818] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:52:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:52:22.011454 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdf644-e8ae-4e7d-80a8-825710d04407 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:22.108032 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdf644-e8ae-4e7d-80a8-825710d04407 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:22.141384 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447f21a-5830-4565-926d-26b863f9cf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:22.141922 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447f21a-5830-4565-926d-26b863f9cf94 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:22.142202 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447f21a-5830-4565-926d-26b863f9cf94 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:22.142476 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447f21a-5830-4565-926d-26b863f9cf94 None admin] PATH_INFO: `/v3/services` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:22.143095 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447f21a-5830-4565-926d-26b863f9cf94 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:52:22.143397 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447f21a-5830-4565-926d-26b863f9cf94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:22.144781 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447f21a-5830-4565-926d-26b863f9cf94 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:22.149849 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 399/819] 10.222.0.43 () {56 vars in 1112 bytes} [Fri Aug 19 03:52:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:52:22.155655 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b2326-266d-45fa-aa2f-ab3c59088ea8 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:22.178960 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:22.255479 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b2326-266d-45fa-aa2f-ab3c59088ea8 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:22.288003 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3ecaa-0697-42d0-9dfe-7bd7455f4552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:22.288623 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3ecaa-0697-42d0-9dfe-7bd7455f4552 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:22.288899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3ecaa-0697-42d0-9dfe-7bd7455f4552 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:22.289168 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3ecaa-0697-42d0-9dfe-7bd7455f4552 None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:22.289777 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3ecaa-0697-42d0-9dfe-7bd7455f4552 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:52:22.290070 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3ecaa-0697-42d0-9dfe-7bd7455f4552 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:22.291423 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3ecaa-0697-42d0-9dfe-7bd7455f4552 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:22.295933 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 421/820] 10.222.0.43 () {56 vars in 1112 bytes} [Fri Aug 19 03:52:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:52:22.301960 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447f21a-5830-4565-926d-26b863f9cf94 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:52:22.325534 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:22.399819 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447f21a-5830-4565-926d-26b863f9cf94 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:52:22.432978 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb459027-a6ce-4809-8df7-a754e650f319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:52:22.433570 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb459027-a6ce-4809-8df7-a754e650f319 None admin] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:52:22.433849 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb459027-a6ce-4809-8df7-a754e650f319 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:52:22.434127 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb459027-a6ce-4809-8df7-a754e650f319 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:52:22.434781 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb459027-a6ce-4809-8df7-a754e650f319 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:52:22.436138 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb459027-a6ce-4809-8df7-a754e650f319 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:52:22.454442 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 400/821] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 03:52:22 2022] POST /identity/v3/endpoints => generated 334 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:52:32.294034 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=58 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:52:32.450849 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=60,keystone:INSERT=1 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:23.907193 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb4c13-56b3-4f79-a6cc-878c026346ba None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:23.907786 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb4c13-56b3-4f79-a6cc-878c026346ba None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:23.907786 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb4c13-56b3-4f79-a6cc-878c026346ba None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:23.909408 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 422/822] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:53:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:53:23.915604 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cb500-1216-41c5-a59b-4a31a8c11fa5 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:23.916084 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cb500-1216-41c5-a59b-4a31a8c11fa5 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:23.916173 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cb500-1216-41c5-a59b-4a31a8c11fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:23.938936 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-6e5cb500-1216-41c5-a59b-4a31a8c11fa5 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:53:23.940727 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-6e5cb500-1216-41c5-a59b-4a31a8c11fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:53:24.023429 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 401/823] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:53:23 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 03:53:24.381984 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb4c13-56b3-4f79-a6cc-878c026346ba None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:24.505267 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb4c13-56b3-4f79-a6cc-878c026346ba None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:24.543607 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ac382-5ec8-41f6-a2b4-b3ed8368c26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:24.544368 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ac382-5ec8-41f6-a2b4-b3ed8368c26e None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:24.544725 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ac382-5ec8-41f6-a2b4-b3ed8368c26e None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:24.545126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ac382-5ec8-41f6-a2b4-b3ed8368c26e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:24.556966 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ac382-5ec8-41f6-a2b4-b3ed8368c26e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:24.558737 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ac382-5ec8-41f6-a2b4-b3ed8368c26e None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:24.577801 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-1d1ac382-5ec8-41f6-a2b4-b3ed8368c26e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:53:24.577801 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:24.577801 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:24.577801 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:24.577801 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:24.577801 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:24.577801 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:24.577801 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:24.577801 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:24.577801 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:24.577801 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:24.577801 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:24.577801 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:53:24.577801 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:53:24.577801 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:53:24.577801 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:53:24.578891 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:24.578891 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:24.578891 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:24.578891 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:24.578891 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:24.578891 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:24.578891 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:24.578891 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:24.578891 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:24.578891 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:24.578891 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:24.578891 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:24.578891 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:24.578891 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:24.578891 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:24.578891 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:24.578891 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:53:24.579955 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:53:24.579955 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:53:24.579955 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:53:24.579955 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 423/824] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:53:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:24.586321 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cb500-1216-41c5-a59b-4a31a8c11fa5 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:24.708869 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cb500-1216-41c5-a59b-4a31a8c11fa5 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:24.739435 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:24.751064 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb39e0-b569-46c0-884b-9357ba5d9803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:24.751796 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb39e0-b569-46c0-884b-9357ba5d9803 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:24.752082 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb39e0-b569-46c0-884b-9357ba5d9803 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:24.752426 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb39e0-b569-46c0-884b-9357ba5d9803 None admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:24.753127 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb39e0-b569-46c0-884b-9357ba5d9803 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:24.753499 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb39e0-b569-46c0-884b-9357ba5d9803 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:24.754911 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb39e0-b569-46c0-884b-9357ba5d9803 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:24.769213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 402/825] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:24.774890 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ac382-5ec8-41f6-a2b4-b3ed8368c26e None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:24.844831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:24.911039 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ac382-5ec8-41f6-a2b4-b3ed8368c26e None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:24.951011 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f4078-1538-4dd2-b115-864325ba77bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:24.952006 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f4078-1538-4dd2-b115-864325ba77bd None admin] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:24.952314 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f4078-1538-4dd2-b115-864325ba77bd None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:24.952743 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f4078-1538-4dd2-b115-864325ba77bd None admin] PATH_INFO: `/v3/users` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:24.953422 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f4078-1538-4dd2-b115-864325ba77bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:24.955127 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f4078-1538-4dd2-b115-864325ba77bd None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:24.977432 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 424/826] 10.222.0.43 () {60 vars in 1132 bytes} [Fri Aug 19 03:53:24 2022] POST /identity/v3/users => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:53:27.460878 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303a3c5-9381-4aa8-8103-f2cad0ae14d5 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:27.461520 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303a3c5-9381-4aa8-8103-f2cad0ae14d5 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:27.461520 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303a3c5-9381-4aa8-8103-f2cad0ae14d5 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:27.462654 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 403/827] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:53:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:53:27.468737 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148ce7f-da8e-4a88-b8df-4e7ed21d4a84 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:27.469162 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148ce7f-da8e-4a88-b8df-4e7ed21d4a84 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:27.469306 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148ce7f-da8e-4a88-b8df-4e7ed21d4a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:27.488572 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-7148ce7f-da8e-4a88-b8df-4e7ed21d4a84 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:53:27.489768 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-7148ce7f-da8e-4a88-b8df-4e7ed21d4a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:53:27.560160 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 425/828] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:53:27 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 03:53:27.892383 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303a3c5-9381-4aa8-8103-f2cad0ae14d5 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:28.018168 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303a3c5-9381-4aa8-8103-f2cad0ae14d5 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:28.058427 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4870f-6f78-406a-a4b3-12906248b7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:28.059227 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4870f-6f78-406a-a4b3-12906248b7fe None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:28.059529 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4870f-6f78-406a-a4b3-12906248b7fe None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:28.059901 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4870f-6f78-406a-a4b3-12906248b7fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:28.073704 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4870f-6f78-406a-a4b3-12906248b7fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:53:28.080027 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-10f4870f-6f78-406a-a4b3-12906248b7fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:53:28.080027 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:28.080027 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:28.080027 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:28.080027 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:28.080027 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:28.080027 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:28.080027 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:28.080027 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:28.080027 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:28.080027 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:28.080027 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:28.080027 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:53:28.080027 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:53:28.080027 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:53:28.080027 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:53:28.081242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:53:28.081242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:53:28.081242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:53:28.081242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:53:28.081242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:28.081242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:28.081242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:28.081242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:28.081242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:28.081242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:28.081242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:28.081242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:28.081242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:28.081242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:28.081242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:28.081242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:28.082284 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:28.082284 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:28.082284 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:28.082284 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:28.082284 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:53:28.082284 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:53:28.082284 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:53:28.082284 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:53:28.082284 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:53:28.082284 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:53:28.082284 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:53:28.082284 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:53:28.082284 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 404/829] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 03:53:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 03:53:28.087602 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148ce7f-da8e-4a88-b8df-4e7ed21d4a84 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:28.135292 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:28.206605 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148ce7f-da8e-4a88-b8df-4e7ed21d4a84 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:28.245686 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3702cf-8abf-4439-bb4e-d1a5064ecfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:28.246333 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3702cf-8abf-4439-bb4e-d1a5064ecfb2 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:28.246674 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3702cf-8abf-4439-bb4e-d1a5064ecfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:28.246959 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3702cf-8abf-4439-bb4e-d1a5064ecfb2 None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:28.247641 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3702cf-8abf-4439-bb4e-d1a5064ecfb2 None admin] RBAC: Adding query filter params (name=service) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:28.248037 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3702cf-8abf-4439-bb4e-d1a5064ecfb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:28.249654 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3702cf-8abf-4439-bb4e-d1a5064ecfb2 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:28.258645 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 426/830] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 03:53:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:28.265121 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4870f-6f78-406a-a4b3-12906248b7fe None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:28.315741 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:28.373780 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4870f-6f78-406a-a4b3-12906248b7fe None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:28.408509 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe424b1-210c-45c6-a904-488195fbfce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:28.409148 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe424b1-210c-45c6-a904-488195fbfce1 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:28.409428 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe424b1-210c-45c6-a904-488195fbfce1 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:28.409704 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe424b1-210c-45c6-a904-488195fbfce1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:28.421034 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe424b1-210c-45c6-a904-488195fbfce1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:28.422761 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe424b1-210c-45c6-a904-488195fbfce1 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:28.438367 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-dbe424b1-210c-45c6-a904-488195fbfce1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:53:28.438367 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:28.438367 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:28.438367 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:28.438367 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:28.438367 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:28.438367 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:28.438367 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:28.438367 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:28.438367 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:28.438367 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:28.438367 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:28.438367 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:53:28.438367 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:53:28.438367 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:53:28.438367 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:53:28.439499 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:28.439499 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:28.439499 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:28.439499 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:28.439499 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:28.439499 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:28.439499 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:28.439499 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:28.439499 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:28.439499 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:28.439499 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:28.439499 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:28.439499 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:28.439499 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:28.439499 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:28.439499 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:28.439499 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:53:28.440785 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:53:28.440785 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:53:28.440785 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:53:28.444516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 405/831] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:53:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:28.445928 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3702cf-8abf-4439-bb4e-d1a5064ecfb2 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:28.551064 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:28.554432 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3702cf-8abf-4439-bb4e-d1a5064ecfb2 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:28.588439 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bee46-c7e5-4c27-bf31-2297b774231e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:28.589091 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bee46-c7e5-4c27-bf31-2297b774231e None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:28.589403 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bee46-c7e5-4c27-bf31-2297b774231e None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:28.589713 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bee46-c7e5-4c27-bf31-2297b774231e None admin] PATH_INFO: `/v3/domains` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:28.590418 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662bee46-c7e5-4c27-bf31-2297b774231e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:28.590763 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662bee46-c7e5-4c27-bf31-2297b774231e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:28.592221 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662bee46-c7e5-4c27-bf31-2297b774231e None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:28.605951 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 427/832] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:28.611940 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe424b1-210c-45c6-a904-488195fbfce1 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:28.713108 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:28.717221 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe424b1-210c-45c6-a904-488195fbfce1 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:28.753537 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956b382-f237-434f-bd9c-48847a18b764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:28.754242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956b382-f237-434f-bd9c-48847a18b764 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:28.754525 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956b382-f237-434f-bd9c-48847a18b764 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:28.754819 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956b382-f237-434f-bd9c-48847a18b764 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:28.762340 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956b382-f237-434f-bd9c-48847a18b764 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:28.763922 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956b382-f237-434f-bd9c-48847a18b764 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:28.777188 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-b956b382-f237-434f-bd9c-48847a18b764 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 03:53:28.777188 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:28.777188 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:28.777188 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:28.777188 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:28.777188 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:28.777188 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:28.777188 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:28.777188 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:28.777188 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:28.777188 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:28.777188 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:28.777188 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 03:53:28.777188 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 03:53:28.777188 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 03:53:28.777188 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 03:53:28.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:28.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:28.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 03:53:28.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:53:28.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 03:53:28.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:53:28.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:28.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:28.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:28.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:28.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:28.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:28.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:28.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:28.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:28.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:28.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:28.778213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:28.779459 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:28.779459 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:28.779459 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 03:53:28.779459 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 03:53:28.779459 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 03:53:28.779459 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 03:53:28.779459 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 03:53:28.779459 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 03:53:28.779459 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 03:53:28.779459 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:53:28.779459 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 406/833] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:53:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:28.784153 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bee46-c7e5-4c27-bf31-2297b774231e None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:28.898309 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bee46-c7e5-4c27-bf31-2297b774231e None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:28.933938 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d69492-cf08-437e-88d8-b9d83856c141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:28.934547 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d69492-cf08-437e-88d8-b9d83856c141 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:28.935042 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d69492-cf08-437e-88d8-b9d83856c141 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:28.935250 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d69492-cf08-437e-88d8-b9d83856c141 None admin] PATH_INFO: `/v3/users` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:28.936148 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d69492-cf08-437e-88d8-b9d83856c141 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:28.936426 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d69492-cf08-437e-88d8-b9d83856c141 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:28.938055 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d69492-cf08-437e-88d8-b9d83856c141 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:28.959663 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 428/834] 10.222.0.43 () {56 vars in 1143 bytes} [Fri Aug 19 03:53:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:28.970373 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956b382-f237-434f-bd9c-48847a18b764 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:29.098756 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956b382-f237-434f-bd9c-48847a18b764 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:29.133613 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969175e8-50d9-47ee-b1b7-82704edca7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:29.134221 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969175e8-50d9-47ee-b1b7-82704edca7ea None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:29.134495 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969175e8-50d9-47ee-b1b7-82704edca7ea None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:29.134776 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969175e8-50d9-47ee-b1b7-82704edca7ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:29.167592 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:29.215508 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969175e8-50d9-47ee-b1b7-82704edca7ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:29.217339 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969175e8-50d9-47ee-b1b7-82704edca7ea None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:29.327189 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 407/835] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:53:28 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 03:53:29.333580 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d69492-cf08-437e-88d8-b9d83856c141 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:29.356308 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:29.447992 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d69492-cf08-437e-88d8-b9d83856c141 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:29.485682 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a181451-08a9-4d51-8d96-ad61e2554be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:29.486311 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a181451-08a9-4d51-8d96-ad61e2554be8 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:29.486600 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a181451-08a9-4d51-8d96-ad61e2554be8 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:29.486980 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a181451-08a9-4d51-8d96-ad61e2554be8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:29.498886 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a181451-08a9-4d51-8d96-ad61e2554be8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:29.500513 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a181451-08a9-4d51-8d96-ad61e2554be8 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:29.517486 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-2a181451-08a9-4d51-8d96-ad61e2554be8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:53:29.517486 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:29.517486 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:29.517486 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:29.517486 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:29.517486 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:29.517486 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:29.517486 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:29.517486 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:29.517486 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:29.517486 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:29.517486 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:29.517486 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:53:29.517486 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:53:29.517486 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:53:29.517486 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:53:29.518761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:29.518761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:29.518761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:29.518761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:29.518761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:29.518761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:29.518761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:29.518761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:29.518761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:29.518761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:29.518761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:29.518761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:29.518761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:29.518761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:29.518761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:29.518761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:29.518761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:53:29.519899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:53:29.519899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:53:29.519899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:53:29.519899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 429/836] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:53:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:29.524669 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969175e8-50d9-47ee-b1b7-82704edca7ea None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:29.589305 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:29.634642 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969175e8-50d9-47ee-b1b7-82704edca7ea None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:29.674042 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4331a61-0591-4b64-ba33-db41cd1413a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:29.674660 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4331a61-0591-4b64-ba33-db41cd1413a4 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:29.674940 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4331a61-0591-4b64-ba33-db41cd1413a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:29.675243 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4331a61-0591-4b64-ba33-db41cd1413a4 None admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:29.675851 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4331a61-0591-4b64-ba33-db41cd1413a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:29.676155 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4331a61-0591-4b64-ba33-db41cd1413a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:29.677556 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4331a61-0591-4b64-ba33-db41cd1413a4 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:29.689467 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 408/837] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:29.695746 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a181451-08a9-4d51-8d96-ad61e2554be8 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:29.774837 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:29.814254 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a181451-08a9-4d51-8d96-ad61e2554be8 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:29.854901 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea4122-460c-4ab7-82b9-7681a7910226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:29.855510 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea4122-460c-4ab7-82b9-7681a7910226 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:29.855947 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea4122-460c-4ab7-82b9-7681a7910226 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:29.856223 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea4122-460c-4ab7-82b9-7681a7910226 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:29.863522 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea4122-460c-4ab7-82b9-7681a7910226 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:29.865128 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea4122-460c-4ab7-82b9-7681a7910226 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:29.878089 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-91ea4122-460c-4ab7-82b9-7681a7910226 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:53:29.878089 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:29.878089 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:29.878089 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:29.878089 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:29.878089 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:29.878089 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:29.878089 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:29.878089 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:29.878089 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:29.878089 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:29.878089 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:29.878089 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 03:53:29.878089 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 03:53:29.878089 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 03:53:29.879388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 03:53:29.879388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:29.879388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:29.879388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:29.879388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:29.879388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:29.879388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:29.879388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:29.879388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:29.879388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:29.879388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:29.879388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:29.879388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:29.879388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:29.879388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:29.879388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:29.879388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:29.880562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 03:53:29.880562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 03:53:29.880562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 03:53:29.880562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 03:53:29.880562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 03:53:29.880562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 03:53:29.880562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:53:29.880562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:53:29.880562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 430/838] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:53:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:29.885478 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4331a61-0591-4b64-ba33-db41cd1413a4 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:30.004024 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4331a61-0591-4b64-ba33-db41cd1413a4 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:30.027164 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:30.047521 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec6585-54ae-46c3-a6fd-6443ec785c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:30.048169 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec6585-54ae-46c3-a6fd-6443ec785c9b None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:30.048452 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec6585-54ae-46c3-a6fd-6443ec785c9b None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:30.048759 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec6585-54ae-46c3-a6fd-6443ec785c9b None admin] PATH_INFO: `/v3/projects` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:30.049460 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec6585-54ae-46c3-a6fd-6443ec785c9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:30.049815 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec6585-54ae-46c3-a6fd-6443ec785c9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:30.051291 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec6585-54ae-46c3-a6fd-6443ec785c9b None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:30.068519 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 409/839] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 03:53:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:30.071442 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea4122-460c-4ab7-82b9-7681a7910226 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:30.193569 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea4122-460c-4ab7-82b9-7681a7910226 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:30.227932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:30.234984 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294319b3-96c0-4a9d-99c1-9f1dc9d2a0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:30.235593 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294319b3-96c0-4a9d-99c1-9f1dc9d2a0b7 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:30.235875 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294319b3-96c0-4a9d-99c1-9f1dc9d2a0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:30.236235 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294319b3-96c0-4a9d-99c1-9f1dc9d2a0b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:30.236973 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294319b3-96c0-4a9d-99c1-9f1dc9d2a0b7 None admin] RBAC: Adding query filter params (role.id=ad0744b06a1644a5bbbe3f145f6ac4e0, scope.project.id=b09192159c884e73bef832a38e2d5e7c, user.id=366baacae7c143929a64f5b639c17a99) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:30.237280 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294319b3-96c0-4a9d-99c1-9f1dc9d2a0b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:30.238738 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294319b3-96c0-4a9d-99c1-9f1dc9d2a0b7 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:30.244078 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 431/840] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:53:30 2022] GET /identity/v3/role_assignments?user.id=366baacae7c143929a64f5b639c17a99&scope.project.id=b09192159c884e73bef832a38e2d5e7c&role.id=ad0744b06a1644a5bbbe3f145f6ac4e0 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:53:32.660403 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde8211-e4c3-41ca-9458-21d85643f51b None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:32.660982 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde8211-e4c3-41ca-9458-21d85643f51b None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:32.660982 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde8211-e4c3-41ca-9458-21d85643f51b None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:32.662848 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 410/841] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:53:32.668759 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b3fc8-e116-44c7-9a14-80e1cb8b1761 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:32.669221 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b3fc8-e116-44c7-9a14-80e1cb8b1761 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:32.669323 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b3fc8-e116-44c7-9a14-80e1cb8b1761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:32.688505 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-c55b3fc8-e116-44c7-9a14-80e1cb8b1761 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:53:32.689725 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-c55b3fc8-e116-44c7-9a14-80e1cb8b1761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:53:32.762038 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 432/842] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:53:32 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 03:53:33.095231 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde8211-e4c3-41ca-9458-21d85643f51b None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:33.214680 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde8211-e4c3-41ca-9458-21d85643f51b None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:33.257039 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c5fef-538f-4dbe-87cf-01b26a6f28b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:33.257707 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c5fef-538f-4dbe-87cf-01b26a6f28b2 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:33.258021 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c5fef-538f-4dbe-87cf-01b26a6f28b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:33.258295 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c5fef-538f-4dbe-87cf-01b26a6f28b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:33.269824 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c5fef-538f-4dbe-87cf-01b26a6f28b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:53:33.275831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-000c5fef-538f-4dbe-87cf-01b26a6f28b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:53:33.275831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:33.275831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:33.275831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:33.275831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:33.275831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:33.275831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:33.275831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:33.275831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:33.275831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:33.275831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:33.275831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:33.275831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:53:33.275831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:53:33.275831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:53:33.275831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:53:33.277019 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:53:33.277019 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:53:33.277019 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:53:33.277019 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:53:33.277019 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:33.277019 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:33.277019 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:33.277019 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:33.277019 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:33.277019 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:33.277019 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:33.277019 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:33.277019 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:33.277019 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:33.277019 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:33.277019 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:33.277896 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:33.277896 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:33.277896 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:33.277896 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:33.277896 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:53:33.277896 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:53:33.277896 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:53:33.277896 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:53:33.277896 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:53:33.277896 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:53:33.277896 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:53:33.277896 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:53:33.277896 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 411/843] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 03:53:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:33.282957 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b3fc8-e116-44c7-9a14-80e1cb8b1761 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:33.393092 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b3fc8-e116-44c7-9a14-80e1cb8b1761 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:33.418833 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:33.431726 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386f2ee-c792-4042-975f-6567f2e64083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:33.432366 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386f2ee-c792-4042-975f-6567f2e64083 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:33.432707 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386f2ee-c792-4042-975f-6567f2e64083 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:33.432985 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386f2ee-c792-4042-975f-6567f2e64083 None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:33.433685 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386f2ee-c792-4042-975f-6567f2e64083 None admin] RBAC: Adding query filter params (name=service) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:33.434057 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386f2ee-c792-4042-975f-6567f2e64083 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:33.435572 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386f2ee-c792-4042-975f-6567f2e64083 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:33.444436 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 433/844] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 03:53:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:33.450304 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c5fef-538f-4dbe-87cf-01b26a6f28b2 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:33.493501 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:33.560573 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c5fef-538f-4dbe-87cf-01b26a6f28b2 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:33.603544 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d2ada-2c37-4ac0-9659-8839182ca8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:33.604161 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d2ada-2c37-4ac0-9659-8839182ca8b3 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:33.604443 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d2ada-2c37-4ac0-9659-8839182ca8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:33.604748 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d2ada-2c37-4ac0-9659-8839182ca8b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:33.617333 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d2ada-2c37-4ac0-9659-8839182ca8b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:33.618780 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d2ada-2c37-4ac0-9659-8839182ca8b3 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:33.635354 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-3c3d2ada-2c37-4ac0-9659-8839182ca8b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:53:33.635354 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:33.635354 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:33.635354 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:33.635354 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:33.635354 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:33.635354 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:33.635354 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:33.635354 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:33.635354 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:33.635354 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:33.635354 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:33.635354 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:53:33.635354 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:53:33.635354 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:53:33.635354 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:53:33.636786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:33.636786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:33.636786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:33.636786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:33.636786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:33.636786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:33.636786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:33.636786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:33.636786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:33.636786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:33.636786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:33.636786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:33.636786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:33.636786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:33.636786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:33.636786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:33.636786 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:53:33.638065 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:53:33.638065 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:53:33.638065 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:53:33.638065 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 412/845] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:33.642704 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386f2ee-c792-4042-975f-6567f2e64083 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:33.754220 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386f2ee-c792-4042-975f-6567f2e64083 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:33.790472 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9f316-bdcb-4f5e-8a75-57c01d37330d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:33.791078 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9f316-bdcb-4f5e-8a75-57c01d37330d None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:33.791356 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9f316-bdcb-4f5e-8a75-57c01d37330d None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:33.791729 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9f316-bdcb-4f5e-8a75-57c01d37330d None admin] PATH_INFO: `/v3/domains` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:33.792407 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9f316-bdcb-4f5e-8a75-57c01d37330d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:33.792753 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9f316-bdcb-4f5e-8a75-57c01d37330d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:33.794332 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9f316-bdcb-4f5e-8a75-57c01d37330d None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:33.808314 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 434/846] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:33.814619 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d2ada-2c37-4ac0-9659-8839182ca8b3 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:33.923414 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:33.934546 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d2ada-2c37-4ac0-9659-8839182ca8b3 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:33.971441 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29432b-0889-481e-8d03-c9c17b2ac09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:33.972081 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29432b-0889-481e-8d03-c9c17b2ac09e None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:33.972344 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29432b-0889-481e-8d03-c9c17b2ac09e None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:33.972658 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29432b-0889-481e-8d03-c9c17b2ac09e None admin] PATH_INFO: `/v3/users/placement` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:33.980734 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29432b-0889-481e-8d03-c9c17b2ac09e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:33.982174 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29432b-0889-481e-8d03-c9c17b2ac09e None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:33.994880 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-1d29432b-0889-481e-8d03-c9c17b2ac09e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 03:53:33.994880 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:33.994880 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:33.994880 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:33.994880 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:33.994880 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:33.994880 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:33.994880 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:33.994880 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:33.994880 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:33.994880 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:33.994880 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:33.994880 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 03:53:33.994880 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 03:53:33.994880 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 03:53:33.994880 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 03:53:33.995990 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:33.995990 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:33.995990 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 03:53:33.995990 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:53:33.995990 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 03:53:33.995990 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:53:33.995990 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:33.995990 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:33.995990 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:33.995990 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:33.995990 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:33.995990 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:33.995990 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:33.995990 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:33.995990 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:33.995990 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:33.995990 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:33.995990 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:33.997432 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:33.997432 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:33.997432 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 03:53:33.997432 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 03:53:33.997432 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 03:53:33.997432 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 03:53:33.997432 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 03:53:33.997432 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 03:53:33.997432 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 03:53:33.997432 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:53:33.997432 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 413/847] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:53:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:34.001979 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9f316-bdcb-4f5e-8a75-57c01d37330d None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:34.055287 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:34.115870 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9f316-bdcb-4f5e-8a75-57c01d37330d None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:34.154199 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef967b-9827-421f-bb91-3a5e984f4e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:34.154806 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef967b-9827-421f-bb91-3a5e984f4e62 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:34.155085 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef967b-9827-421f-bb91-3a5e984f4e62 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:34.155361 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef967b-9827-421f-bb91-3a5e984f4e62 None admin] PATH_INFO: `/v3/users` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:34.156078 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef967b-9827-421f-bb91-3a5e984f4e62 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:34.156961 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef967b-9827-421f-bb91-3a5e984f4e62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:34.158677 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef967b-9827-421f-bb91-3a5e984f4e62 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:34.177088 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 435/848] 10.222.0.43 () {56 vars in 1143 bytes} [Fri Aug 19 03:53:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:34.183437 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29432b-0889-481e-8d03-c9c17b2ac09e None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:34.306086 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29432b-0889-481e-8d03-c9c17b2ac09e None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:34.343319 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181682a-b35d-4071-b241-0a6ff7a71206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:34.343956 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181682a-b35d-4071-b241-0a6ff7a71206 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:34.344238 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181682a-b35d-4071-b241-0a6ff7a71206 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:34.344534 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181682a-b35d-4071-b241-0a6ff7a71206 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:34.355801 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181682a-b35d-4071-b241-0a6ff7a71206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:34.357290 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181682a-b35d-4071-b241-0a6ff7a71206 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:34.371867 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-9181682a-b35d-4071-b241-0a6ff7a71206 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:53:34.371867 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:34.371867 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:34.371867 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:34.371867 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:34.371867 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:34.371867 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:34.371867 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:34.371867 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:34.371867 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:34.371867 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:34.371867 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:34.371867 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:53:34.371867 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:53:34.371867 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:53:34.371867 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:53:34.373121 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:34.373121 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:34.373121 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:34.373121 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:34.373121 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:34.373121 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:34.373121 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:34.373121 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:34.373121 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:34.373121 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:34.373121 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:34.373121 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:34.373121 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:34.373121 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:34.373121 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:34.373121 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:34.373121 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:53:34.374076 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:53:34.374076 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:53:34.374076 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:53:34.374076 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 414/849] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:53:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:34.378925 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef967b-9827-421f-bb91-3a5e984f4e62 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:34.483662 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef967b-9827-421f-bb91-3a5e984f4e62 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:34.486544 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:34.520570 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad6e09-eae4-4c92-9181-9358b21b0132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:34.521213 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad6e09-eae4-4c92-9181-9358b21b0132 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:34.521491 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad6e09-eae4-4c92-9181-9358b21b0132 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:34.521768 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad6e09-eae4-4c92-9181-9358b21b0132 None admin] PATH_INFO: `/v3/domains` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:34.522404 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad6e09-eae4-4c92-9181-9358b21b0132 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:34.522707 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad6e09-eae4-4c92-9181-9358b21b0132 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:34.524369 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad6e09-eae4-4c92-9181-9358b21b0132 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:34.535423 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 436/850] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:34.541058 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181682a-b35d-4071-b241-0a6ff7a71206 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:34.544086 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:34.653354 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181682a-b35d-4071-b241-0a6ff7a71206 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:34.691324 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac73b33-22ef-49f9-9f94-b10969aa43e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:34.691956 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac73b33-22ef-49f9-9f94-b10969aa43e3 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:34.692238 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac73b33-22ef-49f9-9f94-b10969aa43e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:34.692544 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac73b33-22ef-49f9-9f94-b10969aa43e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:34.701822 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac73b33-22ef-49f9-9f94-b10969aa43e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:34.701822 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac73b33-22ef-49f9-9f94-b10969aa43e3 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:34.713176 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-2ac73b33-22ef-49f9-9f94-b10969aa43e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:53:34.713176 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:34.713176 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:34.713176 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:34.713176 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:34.713176 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:34.713176 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:34.713176 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:34.713176 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:34.713176 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:34.713176 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:34.713176 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:34.713176 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 03:53:34.713176 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 03:53:34.713176 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 03:53:34.714181 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 03:53:34.714181 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:34.714181 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:34.714181 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:34.714181 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:34.714181 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:34.714181 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:34.714181 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:34.714181 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:34.714181 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:34.714181 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:34.714181 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:34.714181 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:34.714181 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:34.714181 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:34.714181 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:34.714181 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:34.715665 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 03:53:34.715665 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 03:53:34.715665 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 03:53:34.715665 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 03:53:34.715665 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 03:53:34.715665 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 03:53:34.715665 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:53:34.715665 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:53:34.715665 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 415/851] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:53:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:34.720353 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad6e09-eae4-4c92-9181-9358b21b0132 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:34.841279 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad6e09-eae4-4c92-9181-9358b21b0132 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:34.879873 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70db153-572b-4e64-88f1-fb9768f8190c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:34.880529 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70db153-572b-4e64-88f1-fb9768f8190c None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:34.880843 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70db153-572b-4e64-88f1-fb9768f8190c None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:34.881142 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70db153-572b-4e64-88f1-fb9768f8190c None admin] PATH_INFO: `/v3/projects` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:34.881879 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70db153-572b-4e64-88f1-fb9768f8190c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:34.882245 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70db153-572b-4e64-88f1-fb9768f8190c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:34.884036 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70db153-572b-4e64-88f1-fb9768f8190c None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:34.897465 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 437/852] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 03:53:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:34.903756 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac73b33-22ef-49f9-9f94-b10969aa43e3 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:34.968771 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:35.011482 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac73b33-22ef-49f9-9f94-b10969aa43e3 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:35.046584 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce38df-db77-4ebb-a176-585f542acefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:35.047245 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce38df-db77-4ebb-a176-585f542acefe None admin] REQUEST_METHOD: `PUT` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:35.047521 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce38df-db77-4ebb-a176-585f542acefe None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:35.047793 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce38df-db77-4ebb-a176-585f542acefe None admin] PATH_INFO: `/v3/projects/b09192159c884e73bef832a38e2d5e7c/users/366baacae7c143929a64f5b639c17a99/roles/ad0744b06a1644a5bbbe3f145f6ac4e0` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:35.064637 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce38df-db77-4ebb-a176-585f542acefe None admin] RBAC: Authorizing `identity:create_grant(project_id=b09192159c884e73bef832a38e2d5e7c, user_id=366baacae7c143929a64f5b639c17a99, role_id=ad0744b06a1644a5bbbe3f145f6ac4e0)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:35.066078 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce38df-db77-4ebb-a176-585f542acefe None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:35.079763 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 416/853] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 03:53:34 2022] PUT /identity/v3/projects/b09192159c884e73bef832a38e2d5e7c/users/366baacae7c143929a64f5b639c17a99/roles/ad0744b06a1644a5bbbe3f145f6ac4e0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 03:53:37.236839 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05aa550-f62f-4373-8ee5-194d262fe9b6 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:37.237360 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05aa550-f62f-4373-8ee5-194d262fe9b6 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:37.237462 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05aa550-f62f-4373-8ee5-194d262fe9b6 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:37.238887 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 438/854] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:53:37.247656 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212657c-282a-4fb0-ada0-d70d67250ccc None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:37.247656 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212657c-282a-4fb0-ada0-d70d67250ccc None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:37.247656 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212657c-282a-4fb0-ada0-d70d67250ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:37.264312 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-a212657c-282a-4fb0-ada0-d70d67250ccc None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:53:37.265678 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-a212657c-282a-4fb0-ada0-d70d67250ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:53:37.334599 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 417/855] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:53:37 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 03:53:37.660253 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05aa550-f62f-4373-8ee5-194d262fe9b6 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:37.686813 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:37.768843 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05aa550-f62f-4373-8ee5-194d262fe9b6 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:37.803915 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e4abf-8757-4f33-a6f0-fa3e13de0dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:37.804596 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e4abf-8757-4f33-a6f0-fa3e13de0dd8 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:37.804963 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e4abf-8757-4f33-a6f0-fa3e13de0dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:37.805159 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e4abf-8757-4f33-a6f0-fa3e13de0dd8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:37.821185 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e4abf-8757-4f33-a6f0-fa3e13de0dd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:53:37.828812 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-439e4abf-8757-4f33-a6f0-fa3e13de0dd8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:53:37.828812 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:37.828812 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:37.828812 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:37.828812 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:37.828812 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:37.828812 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:37.828812 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:37.828812 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:37.828812 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:37.828812 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:37.828812 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:37.828812 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:53:37.828812 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:53:37.828812 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:53:37.828812 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:53:37.829952 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:53:37.829952 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:53:37.829952 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:53:37.829952 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:53:37.829952 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:37.829952 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:37.829952 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:37.829952 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:37.829952 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:37.829952 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:37.829952 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:37.829952 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:37.829952 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:37.829952 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:37.829952 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:37.829952 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:37.830937 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:37.830937 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:37.830937 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:37.830937 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:37.830937 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:53:37.830937 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:53:37.830937 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:53:37.830937 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:53:37.830937 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:53:37.830937 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:53:37.830937 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 03:53:37.830937 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:53:37.830937 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 439/856] 10.222.0.43 () {56 vars in 1102 bytes} [Fri Aug 19 03:53:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:37.836804 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212657c-282a-4fb0-ada0-d70d67250ccc None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:37.886478 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:37.946808 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212657c-282a-4fb0-ada0-d70d67250ccc None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:37.982839 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd7132-486f-4190-9aea-f9c22cbd9bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:37.983720 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd7132-486f-4190-9aea-f9c22cbd9bd5 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:37.983997 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd7132-486f-4190-9aea-f9c22cbd9bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:37.984268 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd7132-486f-4190-9aea-f9c22cbd9bd5 None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:37.985012 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd7132-486f-4190-9aea-f9c22cbd9bd5 None admin] RBAC: Adding query filter params (name=service) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:37.985345 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd7132-486f-4190-9aea-f9c22cbd9bd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:37.986873 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd7132-486f-4190-9aea-f9c22cbd9bd5 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:38.002049 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 418/857] 10.222.0.43 () {56 vars in 1103 bytes} [Fri Aug 19 03:53:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:38.003485 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e4abf-8757-4f33-a6f0-fa3e13de0dd8 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:38.091394 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:38.109637 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e4abf-8757-4f33-a6f0-fa3e13de0dd8 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:38.144289 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0ab5b-f3b5-4fa0-9f79-cf9ec7fd558a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:38.144950 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0ab5b-f3b5-4fa0-9f79-cf9ec7fd558a None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:38.145250 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0ab5b-f3b5-4fa0-9f79-cf9ec7fd558a None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:38.145536 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0ab5b-f3b5-4fa0-9f79-cf9ec7fd558a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:38.155635 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0ab5b-f3b5-4fa0-9f79-cf9ec7fd558a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:38.157224 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0ab5b-f3b5-4fa0-9f79-cf9ec7fd558a None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:38.172915 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-0bd0ab5b-f3b5-4fa0-9f79-cf9ec7fd558a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:53:38.172915 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:38.172915 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:38.172915 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:38.172915 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:38.172915 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:38.172915 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:38.172915 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:38.172915 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:38.172915 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:38.172915 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:38.172915 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:38.172915 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:53:38.172915 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:53:38.172915 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:53:38.172915 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:53:38.173941 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:38.173941 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:38.173941 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:38.173941 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:38.173941 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:38.173941 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:38.173941 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:38.173941 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:38.173941 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:38.173941 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:38.173941 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:38.173941 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:38.173941 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:38.173941 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:38.173941 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:38.173941 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:38.173941 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:53:38.175602 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:53:38.175602 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:53:38.175602 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:53:38.175602 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 440/858] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:38.180633 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd7132-486f-4190-9aea-f9c22cbd9bd5 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:38.290134 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd7132-486f-4190-9aea-f9c22cbd9bd5 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:38.292411 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:38.326155 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b61cd-2730-4db4-9fbc-63583a237275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:38.326756 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b61cd-2730-4db4-9fbc-63583a237275 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:38.327033 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b61cd-2730-4db4-9fbc-63583a237275 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:38.327303 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b61cd-2730-4db4-9fbc-63583a237275 None admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:38.327944 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b61cd-2730-4db4-9fbc-63583a237275 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:38.328273 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b61cd-2730-4db4-9fbc-63583a237275 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:38.329648 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b61cd-2730-4db4-9fbc-63583a237275 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:38.342301 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 419/859] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:38.347998 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0ab5b-f3b5-4fa0-9f79-cf9ec7fd558a None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:38.456536 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0ab5b-f3b5-4fa0-9f79-cf9ec7fd558a None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:38.494645 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873e851-9c9a-4695-9b5d-217f91a1d22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:38.495275 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873e851-9c9a-4695-9b5d-217f91a1d22a None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:38.495560 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873e851-9c9a-4695-9b5d-217f91a1d22a None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:38.495836 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873e851-9c9a-4695-9b5d-217f91a1d22a None admin] PATH_INFO: `/v3/users/placement` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:38.498979 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:38.503884 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873e851-9c9a-4695-9b5d-217f91a1d22a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:38.506228 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873e851-9c9a-4695-9b5d-217f91a1d22a None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:38.520863 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-3873e851-9c9a-4695-9b5d-217f91a1d22a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 03:53:38.520863 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:38.520863 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:38.520863 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:38.520863 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:38.520863 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:38.520863 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:38.520863 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:38.520863 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:38.520863 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:38.520863 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:38.520863 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:38.520863 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 03:53:38.520863 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 03:53:38.520863 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 03:53:38.520863 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 03:53:38.522040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:38.522040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:38.522040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 03:53:38.522040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:53:38.522040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 03:53:38.522040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:53:38.522040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:38.522040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:38.522040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:38.522040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:38.522040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:38.522040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:38.522040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:38.522040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:38.522040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:38.522040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:38.522040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:38.522040 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:38.523224 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:38.523224 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:38.523224 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 03:53:38.523224 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 03:53:38.523224 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 03:53:38.523224 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 03:53:38.523224 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 03:53:38.523224 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 03:53:38.523224 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 03:53:38.523224 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:53:38.523224 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 441/860] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:53:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:38.528391 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b61cd-2730-4db4-9fbc-63583a237275 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:38.634091 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b61cd-2730-4db4-9fbc-63583a237275 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:38.669325 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329334e-f6fa-4afa-80fb-78efbc745bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:38.669915 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329334e-f6fa-4afa-80fb-78efbc745bfa None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:38.670196 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329334e-f6fa-4afa-80fb-78efbc745bfa None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:38.670472 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329334e-f6fa-4afa-80fb-78efbc745bfa None admin] PATH_INFO: `/v3/users` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:38.671185 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329334e-f6fa-4afa-80fb-78efbc745bfa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:38.671491 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329334e-f6fa-4afa-80fb-78efbc745bfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:38.672955 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329334e-f6fa-4afa-80fb-78efbc745bfa None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:38.691490 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 420/861] 10.222.0.43 () {56 vars in 1143 bytes} [Fri Aug 19 03:53:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 03:53:38.697967 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873e851-9c9a-4695-9b5d-217f91a1d22a None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:38.805778 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873e851-9c9a-4695-9b5d-217f91a1d22a None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:38.847008 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135025e7-1ad7-449e-aebf-b48cf231d84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:38.847611 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135025e7-1ad7-449e-aebf-b48cf231d84f None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:38.847974 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135025e7-1ad7-449e-aebf-b48cf231d84f None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:38.848280 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135025e7-1ad7-449e-aebf-b48cf231d84f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:38.926906 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:38.934050 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135025e7-1ad7-449e-aebf-b48cf231d84f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:38.935612 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135025e7-1ad7-449e-aebf-b48cf231d84f None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:39.044126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 442/862] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:53:38 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 03:53:39.051765 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329334e-f6fa-4afa-80fb-78efbc745bfa None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:39.079775 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:39.162745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329334e-f6fa-4afa-80fb-78efbc745bfa None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:39.206572 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ad456-62f7-426f-94d7-f3501bdf8052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:39.207179 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ad456-62f7-426f-94d7-f3501bdf8052 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:39.207539 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ad456-62f7-426f-94d7-f3501bdf8052 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:39.207763 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ad456-62f7-426f-94d7-f3501bdf8052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:39.218410 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ad456-62f7-426f-94d7-f3501bdf8052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:39.219892 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ad456-62f7-426f-94d7-f3501bdf8052 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:39.234536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-7e5ad456-62f7-426f-94d7-f3501bdf8052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:53:39.234536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:39.234536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:39.234536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:39.234536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:39.234536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:39.234536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:39.234536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:39.234536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:39.234536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:39.234536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:39.234536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:39.234536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:53:39.234536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:53:39.234536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:53:39.234536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:53:39.235701 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:39.235701 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:39.235701 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:39.235701 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:39.235701 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:39.235701 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:39.235701 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:39.235701 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:39.235701 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:39.235701 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:39.235701 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:39.235701 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:39.235701 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:39.235701 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:39.235701 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:39.235701 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:39.235701 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:53:39.236673 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:53:39.236673 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:53:39.236673 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:53:39.236673 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 421/863] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:53:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:39.242330 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135025e7-1ad7-449e-aebf-b48cf231d84f None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:39.341706 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:39.348581 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135025e7-1ad7-449e-aebf-b48cf231d84f None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:39.388194 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a3ad4-734d-4a6b-9808-61fa0043730b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:39.388944 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a3ad4-734d-4a6b-9808-61fa0043730b None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:39.389225 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a3ad4-734d-4a6b-9808-61fa0043730b None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:39.389499 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a3ad4-734d-4a6b-9808-61fa0043730b None admin] PATH_INFO: `/v3/domains` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:39.390288 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a3ad4-734d-4a6b-9808-61fa0043730b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:39.390625 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a3ad4-734d-4a6b-9808-61fa0043730b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:39.392005 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a3ad4-734d-4a6b-9808-61fa0043730b None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:39.403993 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 443/864] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:39.410131 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ad456-62f7-426f-94d7-f3501bdf8052 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:39.494677 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:39.522142 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ad456-62f7-426f-94d7-f3501bdf8052 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:39.558910 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3499d-3ae3-460c-9318-bc0bc47bccef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:39.559533 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3499d-3ae3-460c-9318-bc0bc47bccef None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:39.559806 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3499d-3ae3-460c-9318-bc0bc47bccef None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:39.560075 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3499d-3ae3-460c-9318-bc0bc47bccef None admin] PATH_INFO: `/v3/projects/service` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:39.568089 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3499d-3ae3-460c-9318-bc0bc47bccef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:39.569895 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3499d-3ae3-460c-9318-bc0bc47bccef None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:39.583215 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-50d3499d-3ae3-460c-9318-bc0bc47bccef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:53:39.583215 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:39.583215 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:39.583215 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:39.583215 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:39.583215 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:39.583215 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:39.583215 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:39.583215 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:39.583215 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:39.583215 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:39.583215 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:39.583215 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 03:53:39.583215 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 03:53:39.583215 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 03:53:39.584296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 03:53:39.584296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:39.584296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:39.584296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:39.584296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:39.584296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:39.584296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:39.584296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:39.584296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:39.584296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:39.584296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:39.584296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:39.584296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:39.584296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:39.584296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:39.584296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:39.584296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:39.585451 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 03:53:39.585451 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 03:53:39.585451 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 03:53:39.585451 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 03:53:39.585451 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 03:53:39.585451 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 03:53:39.585451 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:53:39.585451 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:53:39.585451 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 422/865] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:53:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:39.590624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a3ad4-734d-4a6b-9808-61fa0043730b None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:39.703924 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a3ad4-734d-4a6b-9808-61fa0043730b None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:39.739307 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5110e9-4151-4d2f-85a4-19bb3dfb4fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:39.740019 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5110e9-4151-4d2f-85a4-19bb3dfb4fcd None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:39.740311 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5110e9-4151-4d2f-85a4-19bb3dfb4fcd None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:39.740692 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5110e9-4151-4d2f-85a4-19bb3dfb4fcd None admin] PATH_INFO: `/v3/projects` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:39.741301 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5110e9-4151-4d2f-85a4-19bb3dfb4fcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:39.741629 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5110e9-4151-4d2f-85a4-19bb3dfb4fcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:39.743043 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5110e9-4151-4d2f-85a4-19bb3dfb4fcd None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:39.756325 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 444/866] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 03:53:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:39.762562 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3499d-3ae3-460c-9318-bc0bc47bccef None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:39.892884 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3499d-3ae3-460c-9318-bc0bc47bccef None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:39.932510 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d4e27-6b75-47db-a2ba-8402773b782c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:39.933116 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d4e27-6b75-47db-a2ba-8402773b782c None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:39.933391 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d4e27-6b75-47db-a2ba-8402773b782c None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:39.933663 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d4e27-6b75-47db-a2ba-8402773b782c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:39.934461 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d4e27-6b75-47db-a2ba-8402773b782c None admin] RBAC: Adding query filter params (role.id=ad0744b06a1644a5bbbe3f145f6ac4e0, scope.project.id=b09192159c884e73bef832a38e2d5e7c, user.id=366baacae7c143929a64f5b639c17a99) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:39.934809 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d4e27-6b75-47db-a2ba-8402773b782c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:39.936380 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d4e27-6b75-47db-a2ba-8402773b782c None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:39.938517 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:39.944413 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 423/867] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:53:39 2022] GET /identity/v3/role_assignments?user.id=366baacae7c143929a64f5b639c17a99&scope.project.id=b09192159c884e73bef832a38e2d5e7c&role.id=ad0744b06a1644a5bbbe3f145f6ac4e0 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:42.312218 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620c7a7-50b9-445a-8701-a032250c7567 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:42.312839 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620c7a7-50b9-445a-8701-a032250c7567 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:42.312839 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620c7a7-50b9-445a-8701-a032250c7567 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:42.314209 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 445/868] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:53:42.324420 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a816f3-4f36-4f13-b777-b5a635046081 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:42.324420 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a816f3-4f36-4f13-b777-b5a635046081 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:42.324420 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a816f3-4f36-4f13-b777-b5a635046081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:42.342567 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-93a816f3-4f36-4f13-b777-b5a635046081 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:53:42.344165 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-93a816f3-4f36-4f13-b777-b5a635046081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:53:42.424930 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 424/869] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:53:42 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 03:53:42.761677 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620c7a7-50b9-445a-8701-a032250c7567 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:42.781015 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:42.875612 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620c7a7-50b9-445a-8701-a032250c7567 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:42.913010 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fc4a0-55b9-4bbf-a0b5-519db87e92e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:42.913650 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fc4a0-55b9-4bbf-a0b5-519db87e92e6 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:42.913926 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fc4a0-55b9-4bbf-a0b5-519db87e92e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:42.914197 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fc4a0-55b9-4bbf-a0b5-519db87e92e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:42.925336 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fc4a0-55b9-4bbf-a0b5-519db87e92e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:53:42.930075 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-aa2fc4a0-55b9-4bbf-a0b5-519db87e92e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:53:42.930075 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:42.930075 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:42.930075 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:42.930075 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:42.930075 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:42.930075 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:42.930075 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:42.930075 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:42.930075 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:42.930075 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:42.930075 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:42.930075 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:53:42.930075 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:53:42.930075 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:53:42.930075 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:53:42.931120 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:53:42.931120 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:53:42.931120 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:53:42.931120 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:53:42.931120 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:42.931120 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:42.931120 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:42.931120 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:42.931120 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:42.931120 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:42.931120 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:42.931120 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:42.931120 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:42.931120 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:42.931120 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:42.931120 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:42.932070 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:42.932070 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:42.932070 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:42.932070 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:42.932070 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:53:42.932070 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:53:42.932070 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:53:42.932070 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:53:42.932070 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:53:42.932070 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:53:42.932070 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:53:42.932070 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:53:42.932070 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 446/870] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 03:53:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:42.939466 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a816f3-4f36-4f13-b777-b5a635046081 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:43.042128 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a816f3-4f36-4f13-b777-b5a635046081 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:43.069346 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:43.077752 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3391bd-578c-48d8-a8ad-ec40bfc0eb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:43.078361 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3391bd-578c-48d8-a8ad-ec40bfc0eb62 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:43.078642 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3391bd-578c-48d8-a8ad-ec40bfc0eb62 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:43.078917 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3391bd-578c-48d8-a8ad-ec40bfc0eb62 None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:43.079577 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3391bd-578c-48d8-a8ad-ec40bfc0eb62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:43.079882 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3391bd-578c-48d8-a8ad-ec40bfc0eb62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:43.081399 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3391bd-578c-48d8-a8ad-ec40bfc0eb62 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:43.090300 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 425/871] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:53:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:43.096234 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fc4a0-55b9-4bbf-a0b5-519db87e92e6 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:43.174145 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:43.198390 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fc4a0-55b9-4bbf-a0b5-519db87e92e6 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:43.232075 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8d128-0a2a-4fe1-9398-558aa2585ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:43.232726 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8d128-0a2a-4fe1-9398-558aa2585ea8 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:43.233005 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8d128-0a2a-4fe1-9398-558aa2585ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:43.233276 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8d128-0a2a-4fe1-9398-558aa2585ea8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:43.243496 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8d128-0a2a-4fe1-9398-558aa2585ea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:43.244977 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8d128-0a2a-4fe1-9398-558aa2585ea8 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:43.259604 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-87a8d128-0a2a-4fe1-9398-558aa2585ea8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:53:43.259604 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:43.259604 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:43.259604 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:43.259604 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:43.259604 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:43.259604 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:43.259604 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:43.259604 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:43.259604 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:43.259604 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:43.259604 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:43.259604 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:53:43.259604 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:53:43.259604 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:53:43.259604 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:53:43.260770 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:43.260770 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:43.260770 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:43.260770 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:43.260770 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:43.260770 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:43.260770 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:43.260770 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:43.260770 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:43.260770 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:43.260770 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:43.260770 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:43.260770 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:43.260770 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:43.260770 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:43.260770 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:43.260770 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:53:43.261986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:53:43.261986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:53:43.261986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:53:43.261986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 447/872] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:53:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 03:53:43.269680 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3391bd-578c-48d8-a8ad-ec40bfc0eb62 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:43.368043 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3391bd-578c-48d8-a8ad-ec40bfc0eb62 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:43.400642 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5982854-0830-4f59-9404-885b279a2537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:43.401237 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5982854-0830-4f59-9404-885b279a2537 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:43.401516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5982854-0830-4f59-9404-885b279a2537 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:43.401819 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5982854-0830-4f59-9404-885b279a2537 None admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:43.402446 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5982854-0830-4f59-9404-885b279a2537 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:43.402747 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5982854-0830-4f59-9404-885b279a2537 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:43.404098 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5982854-0830-4f59-9404-885b279a2537 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:43.415271 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 426/873] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:43.420860 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8d128-0a2a-4fe1-9398-558aa2585ea8 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:43.516565 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8d128-0a2a-4fe1-9398-558aa2585ea8 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:43.540876 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:43.548680 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafbc30-febf-40a1-aefb-ef4f33ccce73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:43.549293 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafbc30-febf-40a1-aefb-ef4f33ccce73 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:43.549572 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafbc30-febf-40a1-aefb-ef4f33ccce73 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:43.549846 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafbc30-febf-40a1-aefb-ef4f33ccce73 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:43.557432 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafbc30-febf-40a1-aefb-ef4f33ccce73 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:43.558863 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafbc30-febf-40a1-aefb-ef4f33ccce73 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:43.570090 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-dcafbc30-febf-40a1-aefb-ef4f33ccce73 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 03:53:43.570090 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:43.570090 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:43.570090 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:43.570090 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:43.570090 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:43.570090 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:43.570090 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:43.570090 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:43.570090 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:43.570090 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:43.570090 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:43.570090 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 03:53:43.570090 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 03:53:43.570090 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 03:53:43.570090 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 03:53:43.571242 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:43.571242 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:43.571242 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 03:53:43.571242 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:53:43.571242 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 03:53:43.571242 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:53:43.571242 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:43.571242 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:43.571242 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:43.571242 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:43.571242 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:43.571242 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:43.571242 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:43.571242 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:43.571242 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:43.571242 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:43.571242 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:43.571242 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:43.572231 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:43.572231 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:43.572231 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 03:53:43.572231 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 03:53:43.572231 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 03:53:43.572231 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 03:53:43.572231 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 03:53:43.572231 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 03:53:43.572231 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 03:53:43.572231 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:53:43.572231 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 448/874] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:53:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:43.576838 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5982854-0830-4f59-9404-885b279a2537 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:43.625526 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:43.673391 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5982854-0830-4f59-9404-885b279a2537 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:43.706467 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed838387-b0f1-4148-ac20-d91a509496c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:43.707058 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed838387-b0f1-4148-ac20-d91a509496c0 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:43.707344 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed838387-b0f1-4148-ac20-d91a509496c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:43.707618 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed838387-b0f1-4148-ac20-d91a509496c0 None admin] PATH_INFO: `/v3/users` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:43.708330 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed838387-b0f1-4148-ac20-d91a509496c0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:43.708666 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed838387-b0f1-4148-ac20-d91a509496c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:43.710109 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed838387-b0f1-4148-ac20-d91a509496c0 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:43.726434 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 427/875] 10.222.0.43 () {56 vars in 1143 bytes} [Fri Aug 19 03:53:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:43.731996 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafbc30-febf-40a1-aefb-ef4f33ccce73 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:43.835291 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafbc30-febf-40a1-aefb-ef4f33ccce73 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:43.871971 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1e515-fd0f-4433-a410-651e44b0c230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:43.872589 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1e515-fd0f-4433-a410-651e44b0c230 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:43.872866 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1e515-fd0f-4433-a410-651e44b0c230 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:43.873134 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1e515-fd0f-4433-a410-651e44b0c230 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:43.924507 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:43.937955 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1e515-fd0f-4433-a410-651e44b0c230 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:43.939402 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1e515-fd0f-4433-a410-651e44b0c230 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:44.033507 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 449/876] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:53:43 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 03:53:44.039992 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed838387-b0f1-4148-ac20-d91a509496c0 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:44.136500 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed838387-b0f1-4148-ac20-d91a509496c0 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:44.145445 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:44.170502 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967295a-dd6b-40a2-aa16-e35becdc23f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:44.171127 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967295a-dd6b-40a2-aa16-e35becdc23f4 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:44.171409 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967295a-dd6b-40a2-aa16-e35becdc23f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:44.171682 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967295a-dd6b-40a2-aa16-e35becdc23f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:44.182490 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967295a-dd6b-40a2-aa16-e35becdc23f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:44.183876 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967295a-dd6b-40a2-aa16-e35becdc23f4 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:44.197947 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-4967295a-dd6b-40a2-aa16-e35becdc23f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:53:44.197947 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:44.197947 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:44.197947 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:44.197947 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:44.197947 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:44.197947 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:44.197947 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:44.197947 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:44.197947 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:44.197947 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:44.197947 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:44.197947 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:53:44.197947 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:53:44.197947 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:53:44.197947 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:53:44.199039 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:44.199039 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:44.199039 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:44.199039 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:44.199039 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:44.199039 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:44.199039 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:44.199039 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:44.199039 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:44.199039 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:44.199039 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:44.199039 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:44.199039 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:44.199039 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:44.199039 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:44.199039 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:44.199039 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:53:44.199960 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:53:44.199960 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:53:44.199960 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:53:44.199960 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 428/877] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:44.204887 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1e515-fd0f-4433-a410-651e44b0c230 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:44.296398 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:44.308229 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1e515-fd0f-4433-a410-651e44b0c230 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:44.340324 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc4b72-1358-4629-bdab-94f8db58f009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:44.340945 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc4b72-1358-4629-bdab-94f8db58f009 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:44.341221 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc4b72-1358-4629-bdab-94f8db58f009 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:44.341493 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc4b72-1358-4629-bdab-94f8db58f009 None admin] PATH_INFO: `/v3/domains` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:44.342112 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc4b72-1358-4629-bdab-94f8db58f009 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:44.342409 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc4b72-1358-4629-bdab-94f8db58f009 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:44.343770 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc4b72-1358-4629-bdab-94f8db58f009 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:44.354982 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 450/878] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:44.360648 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967295a-dd6b-40a2-aa16-e35becdc23f4 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:44.456125 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967295a-dd6b-40a2-aa16-e35becdc23f4 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:44.488526 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cf695-21af-425c-ba9c-6246a615de85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:44.489165 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cf695-21af-425c-ba9c-6246a615de85 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:44.489439 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cf695-21af-425c-ba9c-6246a615de85 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:44.489709 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cf695-21af-425c-ba9c-6246a615de85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:44.496280 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105cf695-21af-425c-ba9c-6246a615de85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:44.497725 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105cf695-21af-425c-ba9c-6246a615de85 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:44.508358 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-105cf695-21af-425c-ba9c-6246a615de85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:53:44.508358 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:44.508358 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:44.508358 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:44.508358 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:44.508358 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:44.508358 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:44.508358 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:44.508358 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:44.508358 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:44.508358 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:44.508358 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:44.508358 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 03:53:44.508358 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 03:53:44.508358 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 03:53:44.509567 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 03:53:44.509567 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:44.509567 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:44.509567 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:44.509567 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:44.509567 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:44.509567 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:44.509567 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:44.509567 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:44.509567 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:44.509567 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:44.509567 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:44.509567 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:44.509567 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:44.509567 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:44.509567 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:44.509567 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:44.510816 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 03:53:44.510816 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 03:53:44.510816 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 03:53:44.510816 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 03:53:44.510816 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 03:53:44.510816 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 03:53:44.510816 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:53:44.510816 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:53:44.510816 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 429/879] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:53:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:44.515043 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc4b72-1358-4629-bdab-94f8db58f009 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:44.610901 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc4b72-1358-4629-bdab-94f8db58f009 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:44.643552 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda1da4-671b-4492-b79f-48ed043b39ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:44.644144 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda1da4-671b-4492-b79f-48ed043b39ea None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:44.644423 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda1da4-671b-4492-b79f-48ed043b39ea None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:44.644725 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda1da4-671b-4492-b79f-48ed043b39ea None admin] PATH_INFO: `/v3/projects` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:44.645990 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda1da4-671b-4492-b79f-48ed043b39ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:44.646292 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda1da4-671b-4492-b79f-48ed043b39ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:44.647711 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda1da4-671b-4492-b79f-48ed043b39ea None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:44.659029 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 451/880] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 03:53:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:44.664817 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cf695-21af-425c-ba9c-6246a615de85 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:44.686255 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:44.762747 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cf695-21af-425c-ba9c-6246a615de85 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:44.794916 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a5c9e-0aa5-45a9-831d-1077275440c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:44.795500 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a5c9e-0aa5-45a9-831d-1077275440c8 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:44.795778 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a5c9e-0aa5-45a9-831d-1077275440c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:44.796048 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a5c9e-0aa5-45a9-831d-1077275440c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:44.796780 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a5c9e-0aa5-45a9-831d-1077275440c8 None admin] RBAC: Adding query filter params (role.id=e154509f216e4ae59f74044aa234ddde, scope.project.id=b09192159c884e73bef832a38e2d5e7c, user.id=366baacae7c143929a64f5b639c17a99) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:44.797087 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a5c9e-0aa5-45a9-831d-1077275440c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:44.798489 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a5c9e-0aa5-45a9-831d-1077275440c8 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:44.803640 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 430/881] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:53:44 2022] GET /identity/v3/role_assignments?user.id=366baacae7c143929a64f5b639c17a99&scope.project.id=b09192159c884e73bef832a38e2d5e7c&role.id=e154509f216e4ae59f74044aa234ddde => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:46.944389 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88c9d5-757d-4c10-a492-dbd8cd1e751c None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:46.944941 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88c9d5-757d-4c10-a492-dbd8cd1e751c None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:46.945035 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88c9d5-757d-4c10-a492-dbd8cd1e751c None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:46.946292 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 452/882] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:53:46.951286 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f864bbb-cdba-40a6-bdc0-a4209b3a8286 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:46.951671 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f864bbb-cdba-40a6-bdc0-a4209b3a8286 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:46.951842 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f864bbb-cdba-40a6-bdc0-a4209b3a8286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:46.969456 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-6f864bbb-cdba-40a6-bdc0-a4209b3a8286 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:53:46.970630 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-6f864bbb-cdba-40a6-bdc0-a4209b3a8286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:53:47.034754 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 431/883] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:53:46 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 03:53:47.370269 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88c9d5-757d-4c10-a492-dbd8cd1e751c None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:47.381039 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:47.468649 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88c9d5-757d-4c10-a492-dbd8cd1e751c None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:47.501052 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb60e55-a088-40d3-bf70-2ee6853a4cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:47.501675 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb60e55-a088-40d3-bf70-2ee6853a4cba None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:47.501952 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb60e55-a088-40d3-bf70-2ee6853a4cba None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:47.502222 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb60e55-a088-40d3-bf70-2ee6853a4cba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:47.511844 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb60e55-a088-40d3-bf70-2ee6853a4cba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:53:47.516472 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-cfb60e55-a088-40d3-bf70-2ee6853a4cba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:53:47.516472 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:47.516472 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:47.516472 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:47.516472 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:47.516472 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:47.516472 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:47.516472 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:47.516472 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:47.516472 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:47.516472 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:47.516472 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:47.516472 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:53:47.516472 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:53:47.516472 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:53:47.516472 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:53:47.517562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:53:47.517562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:53:47.517562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:53:47.517562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:53:47.517562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:47.517562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:47.517562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:47.517562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:47.517562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:47.517562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:47.517562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:47.517562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:47.517562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:47.517562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:47.517562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:47.517562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:47.518618 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:47.518618 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:47.518618 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:47.518618 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:47.518618 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:53:47.518618 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:53:47.518618 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:53:47.518618 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:53:47.518618 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:53:47.518618 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:53:47.518618 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:53:47.518618 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:53:47.518618 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 453/884] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 03:53:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:47.524023 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f864bbb-cdba-40a6-bdc0-a4209b3a8286 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:47.539201 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:47.621011 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f864bbb-cdba-40a6-bdc0-a4209b3a8286 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:47.654205 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1491d-4cc4-41af-965b-b052b1a54576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:47.654801 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1491d-4cc4-41af-965b-b052b1a54576 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:47.655082 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1491d-4cc4-41af-965b-b052b1a54576 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:47.655359 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1491d-4cc4-41af-965b-b052b1a54576 None admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:47.656012 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1491d-4cc4-41af-965b-b052b1a54576 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:47.656313 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1491d-4cc4-41af-965b-b052b1a54576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:47.657700 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1491d-4cc4-41af-965b-b052b1a54576 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:47.665440 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 432/885] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:53:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:47.670930 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb60e55-a088-40d3-bf70-2ee6853a4cba None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:47.735827 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:47.768224 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb60e55-a088-40d3-bf70-2ee6853a4cba None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:47.800687 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c84f8-f27a-4cb1-aebd-042161b7cd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:47.801303 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c84f8-f27a-4cb1-aebd-042161b7cd47 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:47.801584 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c84f8-f27a-4cb1-aebd-042161b7cd47 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:47.801858 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c84f8-f27a-4cb1-aebd-042161b7cd47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:47.812776 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c84f8-f27a-4cb1-aebd-042161b7cd47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:47.814225 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c84f8-f27a-4cb1-aebd-042161b7cd47 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:47.830386 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-681c84f8-f27a-4cb1-aebd-042161b7cd47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:53:47.830386 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:47.830386 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:47.830386 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:47.830386 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:47.830386 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:47.830386 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:47.830386 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:47.830386 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:47.830386 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:47.830386 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:47.830386 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:47.830386 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:53:47.830386 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:53:47.830386 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:53:47.830386 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:53:47.831426 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:47.831426 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:47.831426 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:47.831426 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:47.831426 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:47.831426 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:47.831426 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:47.831426 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:47.831426 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:47.831426 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:47.831426 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:47.831426 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:47.831426 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:47.831426 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:47.831426 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:47.831426 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:47.831426 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:53:47.832754 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:53:47.832754 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:53:47.832754 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:53:47.832754 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 454/886] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:53:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:47.838201 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1491d-4cc4-41af-965b-b052b1a54576 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:47.923274 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:47.946822 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1491d-4cc4-41af-965b-b052b1a54576 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:47.978254 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211435a-2fb7-48ae-801d-e25c1f90dbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:47.978846 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211435a-2fb7-48ae-801d-e25c1f90dbd7 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:47.979108 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211435a-2fb7-48ae-801d-e25c1f90dbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:47.979376 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211435a-2fb7-48ae-801d-e25c1f90dbd7 None admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:47.979998 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211435a-2fb7-48ae-801d-e25c1f90dbd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:47.980296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211435a-2fb7-48ae-801d-e25c1f90dbd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:47.981668 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211435a-2fb7-48ae-801d-e25c1f90dbd7 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:47.993643 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 433/887] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:47.999466 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c84f8-f27a-4cb1-aebd-042161b7cd47 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:48.095546 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c84f8-f27a-4cb1-aebd-042161b7cd47 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:48.114741 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:48.129330 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57d483-7d5a-48a2-9cd5-c447ed38dd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:48.129947 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57d483-7d5a-48a2-9cd5-c447ed38dd73 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:48.130228 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57d483-7d5a-48a2-9cd5-c447ed38dd73 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:48.130505 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57d483-7d5a-48a2-9cd5-c447ed38dd73 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:48.137654 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57d483-7d5a-48a2-9cd5-c447ed38dd73 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:48.139092 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57d483-7d5a-48a2-9cd5-c447ed38dd73 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:48.149839 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-5c57d483-7d5a-48a2-9cd5-c447ed38dd73 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 03:53:48.149839 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:48.149839 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:48.149839 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:48.149839 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:48.149839 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:48.149839 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:48.149839 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:48.149839 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:48.149839 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:48.149839 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:48.149839 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:48.149839 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 03:53:48.149839 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 03:53:48.149839 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 03:53:48.149839 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 03:53:48.150953 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:48.150953 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:48.150953 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 03:53:48.150953 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:53:48.150953 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 03:53:48.150953 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:53:48.150953 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:48.150953 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:48.150953 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:48.150953 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:48.150953 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:48.150953 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:48.150953 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:48.150953 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:48.150953 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:48.150953 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:48.150953 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:48.150953 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:48.152276 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:48.152276 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:48.152276 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 03:53:48.152276 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 03:53:48.152276 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 03:53:48.152276 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 03:53:48.152276 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 03:53:48.152276 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 03:53:48.152276 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 03:53:48.152276 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:53:48.152276 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 455/888] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:53:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:48.156691 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211435a-2fb7-48ae-801d-e25c1f90dbd7 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:48.255630 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211435a-2fb7-48ae-801d-e25c1f90dbd7 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:48.288228 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9829b6-84da-4c15-964f-2c2877949e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:48.288851 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9829b6-84da-4c15-964f-2c2877949e5f None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:48.289134 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9829b6-84da-4c15-964f-2c2877949e5f None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:48.289405 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9829b6-84da-4c15-964f-2c2877949e5f None admin] PATH_INFO: `/v3/users` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:48.290106 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9829b6-84da-4c15-964f-2c2877949e5f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:48.290414 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9829b6-84da-4c15-964f-2c2877949e5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:48.291833 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9829b6-84da-4c15-964f-2c2877949e5f None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:48.294474 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:48.309959 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 434/889] 10.222.0.43 () {56 vars in 1143 bytes} [Fri Aug 19 03:53:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:48.315635 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57d483-7d5a-48a2-9cd5-c447ed38dd73 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:48.412042 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57d483-7d5a-48a2-9cd5-c447ed38dd73 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:48.444291 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3d6d2-3b59-450b-8623-ad7fb529a4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:48.444937 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3d6d2-3b59-450b-8623-ad7fb529a4d5 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:48.445213 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3d6d2-3b59-450b-8623-ad7fb529a4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:48.445487 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3d6d2-3b59-450b-8623-ad7fb529a4d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:48.455463 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3d6d2-3b59-450b-8623-ad7fb529a4d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:48.456953 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3d6d2-3b59-450b-8623-ad7fb529a4d5 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:48.470319 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-dff3d6d2-3b59-450b-8623-ad7fb529a4d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:53:48.470319 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:48.470319 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:48.470319 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:48.470319 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:48.470319 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:48.470319 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:48.470319 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:48.470319 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:48.470319 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:48.470319 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:48.470319 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:48.470319 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:53:48.470319 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:53:48.470319 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:53:48.470319 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:53:48.471430 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:48.471430 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:48.471430 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:48.471430 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:48.471430 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:48.471430 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:48.471430 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:48.471430 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:48.471430 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:48.471430 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:48.471430 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:48.471430 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:48.471430 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:48.471430 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:48.471430 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:48.471430 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:48.471430 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:53:48.473070 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:53:48.473070 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:53:48.473070 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:53:48.473070 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 456/890] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:48.477462 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9829b6-84da-4c15-964f-2c2877949e5f None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:48.572989 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9829b6-84da-4c15-964f-2c2877949e5f None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:48.605704 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab6bbc-ee0e-4157-9ca8-3bcf6b5b230f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:48.606286 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab6bbc-ee0e-4157-9ca8-3bcf6b5b230f None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:48.606561 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab6bbc-ee0e-4157-9ca8-3bcf6b5b230f None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:48.606831 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab6bbc-ee0e-4157-9ca8-3bcf6b5b230f None admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:48.607456 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab6bbc-ee0e-4157-9ca8-3bcf6b5b230f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:48.607750 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab6bbc-ee0e-4157-9ca8-3bcf6b5b230f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:48.609111 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab6bbc-ee0e-4157-9ca8-3bcf6b5b230f None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:48.620462 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 435/891] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:48.625839 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3d6d2-3b59-450b-8623-ad7fb529a4d5 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:48.656030 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:48.720925 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3d6d2-3b59-450b-8623-ad7fb529a4d5 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:48.752785 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d143e-cd3b-4e9e-a24c-4d85e830d193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:48.753416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d143e-cd3b-4e9e-a24c-4d85e830d193 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:48.753695 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d143e-cd3b-4e9e-a24c-4d85e830d193 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:48.753964 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d143e-cd3b-4e9e-a24c-4d85e830d193 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:48.760198 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d143e-cd3b-4e9e-a24c-4d85e830d193 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:48.761656 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d143e-cd3b-4e9e-a24c-4d85e830d193 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:48.772800 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-cd7d143e-cd3b-4e9e-a24c-4d85e830d193 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:53:48.772800 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:48.772800 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:48.772800 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:48.772800 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:48.772800 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:48.772800 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:48.772800 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:48.772800 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:48.772800 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:48.772800 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:48.772800 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:48.772800 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 03:53:48.772800 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 03:53:48.772800 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 03:53:48.773672 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 03:53:48.773672 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:48.773672 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:48.773672 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:48.773672 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:48.773672 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:48.773672 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:48.773672 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:48.773672 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:48.773672 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:48.773672 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:48.773672 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:48.773672 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:48.773672 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:48.773672 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:48.773672 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:48.773672 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:48.774785 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 03:53:48.774785 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 03:53:48.774785 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 03:53:48.774785 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 03:53:48.774785 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 03:53:48.774785 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 03:53:48.774785 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:53:48.774785 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:53:48.774785 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 457/892] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:53:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:48.779419 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab6bbc-ee0e-4157-9ca8-3bcf6b5b230f None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:48.838542 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:48.884149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab6bbc-ee0e-4157-9ca8-3bcf6b5b230f None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:48.917106 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c229d-21a1-417e-8a85-304781812b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:48.917692 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c229d-21a1-417e-8a85-304781812b2e None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:48.917975 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c229d-21a1-417e-8a85-304781812b2e None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:48.918252 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c229d-21a1-417e-8a85-304781812b2e None admin] PATH_INFO: `/v3/projects` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:48.918937 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c229d-21a1-417e-8a85-304781812b2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:48.919241 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c229d-21a1-417e-8a85-304781812b2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:48.920695 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c229d-21a1-417e-8a85-304781812b2e None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:48.933151 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 436/893] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 03:53:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:48.939279 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d143e-cd3b-4e9e-a24c-4d85e830d193 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:49.026738 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:49.036362 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d143e-cd3b-4e9e-a24c-4d85e830d193 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:49.073455 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38ae0f-1288-428b-86ec-9848efe0e1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:49.074105 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38ae0f-1288-428b-86ec-9848efe0e1aa None admin] REQUEST_METHOD: `PUT` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:49.074387 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38ae0f-1288-428b-86ec-9848efe0e1aa None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:49.074670 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38ae0f-1288-428b-86ec-9848efe0e1aa None admin] PATH_INFO: `/v3/projects/b09192159c884e73bef832a38e2d5e7c/users/366baacae7c143929a64f5b639c17a99/roles/e154509f216e4ae59f74044aa234ddde` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:49.076584 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38ae0f-1288-428b-86ec-9848efe0e1aa None admin] RBAC: Authorizing `identity:create_grant(project_id=b09192159c884e73bef832a38e2d5e7c, user_id=366baacae7c143929a64f5b639c17a99, role_id=e154509f216e4ae59f74044aa234ddde)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:49.078021 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38ae0f-1288-428b-86ec-9848efe0e1aa None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:49.090459 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 458/894] 10.222.0.43 () {58 vars in 1439 bytes} [Fri Aug 19 03:53:48 2022] PUT /identity/v3/projects/b09192159c884e73bef832a38e2d5e7c/users/366baacae7c143929a64f5b639c17a99/roles/e154509f216e4ae59f74044aa234ddde => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 03:53:51.229716 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e64f3-43a4-4f86-8dec-25f34b5a86e6 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:51.230190 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e64f3-43a4-4f86-8dec-25f34b5a86e6 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:51.230288 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e64f3-43a4-4f86-8dec-25f34b5a86e6 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:51.231590 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 437/895] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:53:51.236782 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1214e56-4a14-4767-a87e-ef1ebfdaf317 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:51.237160 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1214e56-4a14-4767-a87e-ef1ebfdaf317 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:51.237395 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1214e56-4a14-4767-a87e-ef1ebfdaf317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:51.255560 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-e1214e56-4a14-4767-a87e-ef1ebfdaf317 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:53:51.256757 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-e1214e56-4a14-4767-a87e-ef1ebfdaf317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:53:51.321694 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 459/896] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:53:51 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 03:53:51.650260 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e64f3-43a4-4f86-8dec-25f34b5a86e6 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:51.746708 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e64f3-43a4-4f86-8dec-25f34b5a86e6 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:51.760376 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:51.779955 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac902ec7-d17e-4e0a-afb9-18bb6ca20fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:51.780615 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac902ec7-d17e-4e0a-afb9-18bb6ca20fcc None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:51.780899 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac902ec7-d17e-4e0a-afb9-18bb6ca20fcc None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:51.781177 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac902ec7-d17e-4e0a-afb9-18bb6ca20fcc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:51.790983 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac902ec7-d17e-4e0a-afb9-18bb6ca20fcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 03:53:51.795745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-ac902ec7-d17e-4e0a-afb9-18bb6ca20fcc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:53:51.795745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:51.795745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:51.795745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:51.795745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:51.795745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:51.795745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:51.795745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:51.795745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:51.795745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:51.795745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:51.795745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:51.795745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 03:53:51.795745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 03:53:51.795745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 03:53:51.795745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 03:53:51.796876 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 03:53:51.796876 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 03:53:51.796876 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 03:53:51.796876 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 03:53:51.796876 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:51.796876 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:51.796876 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:51.796876 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:51.796876 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:51.796876 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:51.796876 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:51.796876 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:51.796876 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:51.796876 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:51.796876 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:51.796876 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:51.797757 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:51.797757 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:51.797757 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:51.797757 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:51.797757 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 03:53:51.797757 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 03:53:51.797757 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 03:53:51.797757 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 03:53:51.797757 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 03:53:51.797757 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 03:53:51.797757 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 03:53:51.797757 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:53:51.797757 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 438/897] 10.222.0.43 () {56 vars in 1096 bytes} [Fri Aug 19 03:53:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:51.803215 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1214e56-4a14-4767-a87e-ef1ebfdaf317 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:51.889804 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:51.907636 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1214e56-4a14-4767-a87e-ef1ebfdaf317 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:51.939950 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2af90-d638-4d74-92f8-0a0d0f3ceef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:51.941177 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2af90-d638-4d74-92f8-0a0d0f3ceef2 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:51.941454 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2af90-d638-4d74-92f8-0a0d0f3ceef2 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:51.941725 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2af90-d638-4d74-92f8-0a0d0f3ceef2 None admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:51.942371 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2af90-d638-4d74-92f8-0a0d0f3ceef2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:51.942671 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2af90-d638-4d74-92f8-0a0d0f3ceef2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:51.944030 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2af90-d638-4d74-92f8-0a0d0f3ceef2 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:51.951698 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 460/898] 10.222.0.43 () {56 vars in 1099 bytes} [Fri Aug 19 03:53:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:51.957543 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac902ec7-d17e-4e0a-afb9-18bb6ca20fcc None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:52.054099 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac902ec7-d17e-4e0a-afb9-18bb6ca20fcc None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:52.086240 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450a6e7-e403-4dce-ae68-a0e565f6d925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:52.086850 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450a6e7-e403-4dce-ae68-a0e565f6d925 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:52.087128 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450a6e7-e403-4dce-ae68-a0e565f6d925 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:52.087399 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450a6e7-e403-4dce-ae68-a0e565f6d925 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:52.097538 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450a6e7-e403-4dce-ae68-a0e565f6d925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:52.098965 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450a6e7-e403-4dce-ae68-a0e565f6d925 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:52.114060 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-a450a6e7-e403-4dce-ae68-a0e565f6d925 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:53:52.114060 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:52.114060 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:52.114060 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:52.114060 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:52.114060 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:52.114060 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:52.114060 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:52.114060 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:52.114060 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:52.114060 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:52.114060 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:52.114060 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:53:52.114060 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:53:52.114060 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:53:52.114060 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:53:52.115241 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:52.115241 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:52.115241 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:52.115241 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:52.115241 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:52.115241 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:52.115241 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:52.115241 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:52.115241 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:52.115241 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:52.115241 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:52.115241 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:52.115241 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:52.115241 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:52.115241 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:52.115241 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:52.115241 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:53:52.116675 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:53:52.116675 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:53:52.116675 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:53:52.116675 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 439/899] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:53:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:52.121135 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2af90-d638-4d74-92f8-0a0d0f3ceef2 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:52.219514 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2af90-d638-4d74-92f8-0a0d0f3ceef2 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:52.252539 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cf44d-e1e4-4813-b04d-74c515d0eb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:52.253129 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cf44d-e1e4-4813-b04d-74c515d0eb35 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:52.253404 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cf44d-e1e4-4813-b04d-74c515d0eb35 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:52.253678 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cf44d-e1e4-4813-b04d-74c515d0eb35 None admin] PATH_INFO: `/v3/domains` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:52.254302 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655cf44d-e1e4-4813-b04d-74c515d0eb35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:52.254600 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655cf44d-e1e4-4813-b04d-74c515d0eb35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:52.255967 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655cf44d-e1e4-4813-b04d-74c515d0eb35 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:52.267055 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 461/900] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:52.272757 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450a6e7-e403-4dce-ae68-a0e565f6d925 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:52.300617 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:52.372418 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450a6e7-e403-4dce-ae68-a0e565f6d925 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:52.404854 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96052f99-9c81-467f-83cd-38a62d403239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:52.405473 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96052f99-9c81-467f-83cd-38a62d403239 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:52.405752 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96052f99-9c81-467f-83cd-38a62d403239 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:52.406024 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96052f99-9c81-467f-83cd-38a62d403239 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:52.414519 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96052f99-9c81-467f-83cd-38a62d403239 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:52.415943 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96052f99-9c81-467f-83cd-38a62d403239 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:52.426761 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-96052f99-9c81-467f-83cd-38a62d403239 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 03:53:52.426761 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:52.426761 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:52.426761 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:52.426761 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:52.426761 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:52.426761 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:52.426761 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:52.426761 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:52.426761 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:52.426761 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:52.426761 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:52.426761 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 03:53:52.426761 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 03:53:52.426761 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 03:53:52.426761 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 03:53:52.427839 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:52.427839 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:52.427839 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 03:53:52.427839 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:53:52.427839 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 03:53:52.427839 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 03:53:52.427839 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:52.427839 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:52.427839 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:52.427839 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:52.427839 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:52.427839 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:52.427839 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:52.427839 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:52.427839 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:52.427839 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:52.427839 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:52.427839 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:52.429229 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:52.429229 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:52.429229 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 03:53:52.429229 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 03:53:52.429229 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 03:53:52.429229 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 03:53:52.429229 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 03:53:52.429229 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 03:53:52.429229 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 03:53:52.429229 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:53:52.429229 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 440/901] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:53:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:52.433571 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cf44d-e1e4-4813-b04d-74c515d0eb35 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:52.437296 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:52.528175 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cf44d-e1e4-4813-b04d-74c515d0eb35 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:52.562872 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6b9e9-7637-457e-af3a-92bb8c0c55d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:52.563462 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6b9e9-7637-457e-af3a-92bb8c0c55d2 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:52.563737 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6b9e9-7637-457e-af3a-92bb8c0c55d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:52.564006 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6b9e9-7637-457e-af3a-92bb8c0c55d2 None admin] PATH_INFO: `/v3/users` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:52.564737 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6b9e9-7637-457e-af3a-92bb8c0c55d2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:52.565059 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6b9e9-7637-457e-af3a-92bb8c0c55d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:52.566475 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6b9e9-7637-457e-af3a-92bb8c0c55d2 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:52.583287 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 462/902] 10.222.0.43 () {56 vars in 1143 bytes} [Fri Aug 19 03:53:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:52.588966 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96052f99-9c81-467f-83cd-38a62d403239 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:52.671699 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:52.686243 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96052f99-9c81-467f-83cd-38a62d403239 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:52.718492 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf76009-f02d-4f52-ab52-79fa0977df33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:52.719082 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf76009-f02d-4f52-ab52-79fa0977df33 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:52.719361 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf76009-f02d-4f52-ab52-79fa0977df33 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:52.719636 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf76009-f02d-4f52-ab52-79fa0977df33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:52.784724 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf76009-f02d-4f52-ab52-79fa0977df33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:52.786155 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf76009-f02d-4f52-ab52-79fa0977df33 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:52.866153 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:52.881852 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 441/903] 10.222.0.43 () {58 vars in 1282 bytes} [Fri Aug 19 03:53:52 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 03:53:52.887573 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6b9e9-7637-457e-af3a-92bb8c0c55d2 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:52.946326 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:52.984329 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6b9e9-7637-457e-af3a-92bb8c0c55d2 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:53.017120 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6a459-e0b3-4d47-91c3-88d1d3f09919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:53.017735 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6a459-e0b3-4d47-91c3-88d1d3f09919 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:53.018014 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6a459-e0b3-4d47-91c3-88d1d3f09919 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:53.018912 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6a459-e0b3-4d47-91c3-88d1d3f09919 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:53.028577 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b6a459-e0b3-4d47-91c3-88d1d3f09919 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:53.030015 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b6a459-e0b3-4d47-91c3-88d1d3f09919 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:53.044751 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-67b6a459-e0b3-4d47-91c3-88d1d3f09919 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:53:53.044751 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:53.044751 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:53.044751 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:53.044751 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:53.044751 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:53.044751 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:53.044751 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:53.044751 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:53.044751 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:53.044751 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:53.044751 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:53.044751 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 03:53:53.044751 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 03:53:53.044751 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 03:53:53.044751 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 03:53:53.045772 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:53.045772 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:53.045772 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:53.045772 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:53.045772 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:53.045772 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:53.045772 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:53.045772 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:53.045772 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:53.045772 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:53.045772 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:53.045772 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:53.045772 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:53.045772 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:53.045772 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:53.045772 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:53.045772 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 03:53:53.046706 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 03:53:53.046706 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 03:53:53.046706 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:53:53.046706 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 463/904] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:53:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:53.051624 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf76009-f02d-4f52-ab52-79fa0977df33 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:53.149199 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf76009-f02d-4f52-ab52-79fa0977df33 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:53.183666 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdde8d-794f-492f-96fe-86c7b5c6fe51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:53.184751 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdde8d-794f-492f-96fe-86c7b5c6fe51 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:53.185261 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdde8d-794f-492f-96fe-86c7b5c6fe51 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:53.185770 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdde8d-794f-492f-96fe-86c7b5c6fe51 None admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:53.186931 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cdde8d-794f-492f-96fe-86c7b5c6fe51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:53.187489 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cdde8d-794f-492f-96fe-86c7b5c6fe51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:53.190744 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cdde8d-794f-492f-96fe-86c7b5c6fe51 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:53.202263 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 442/905] 10.222.0.43 () {56 vars in 1109 bytes} [Fri Aug 19 03:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:53.207926 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6a459-e0b3-4d47-91c3-88d1d3f09919 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:53.302586 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6a459-e0b3-4d47-91c3-88d1d3f09919 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:53.315928 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:53.336998 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c0bf5-bb80-4f6f-94a5-b6cb5c087a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:53.337625 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c0bf5-bb80-4f6f-94a5-b6cb5c087a88 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:53.337904 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c0bf5-bb80-4f6f-94a5-b6cb5c087a88 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:53.338179 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c0bf5-bb80-4f6f-94a5-b6cb5c087a88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:53.344703 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c0bf5-bb80-4f6f-94a5-b6cb5c087a88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:53.346153 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c0bf5-bb80-4f6f-94a5-b6cb5c087a88 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:53.357001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application [None req-b86c0bf5-bb80-4f6f-94a5-b6cb5c087a88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:53:53.357001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:53.357001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:53.357001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:53.357001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:53.357001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:53.357001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:53.357001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:53.357001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:53.357001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:53.357001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:53.357001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:53.357001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 03:53:53.357001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 03:53:53.357001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 03:53:53.357885 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 03:53:53.357885 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:53.357885 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:53.357885 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:53.357885 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:53.357885 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:53.357885 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:53.357885 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:53.357885 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:53.357885 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:53.357885 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:53.357885 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:53.357885 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:53.357885 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:53.357885 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:53.357885 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:53.357885 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:53.358954 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 03:53:53.358954 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 03:53:53.358954 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 03:53:53.358954 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 03:53:53.358954 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 03:53:53.358954 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 03:53:53.358954 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 03:53:53.358954 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: ERROR keystone.server.flask.application Aug 19 03:53:53.358954 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 464/906] 10.222.0.43 () {56 vars in 1111 bytes} [Fri Aug 19 03:53:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:53.364345 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdde8d-794f-492f-96fe-86c7b5c6fe51 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:53.410170 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:53.462801 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdde8d-794f-492f-96fe-86c7b5c6fe51 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:53.495038 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f6088-a5b0-4b17-8d01-c2a6a73961b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:53.495624 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f6088-a5b0-4b17-8d01-c2a6a73961b8 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:53.495900 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f6088-a5b0-4b17-8d01-c2a6a73961b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:53.496173 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f6088-a5b0-4b17-8d01-c2a6a73961b8 None admin] PATH_INFO: `/v3/projects` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:53.496872 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f6088-a5b0-4b17-8d01-c2a6a73961b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:53.497174 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f6088-a5b0-4b17-8d01-c2a6a73961b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:53.498585 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f6088-a5b0-4b17-8d01-c2a6a73961b8 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:53.510573 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 443/907] 10.222.0.43 () {56 vars in 1148 bytes} [Fri Aug 19 03:53:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:53.516607 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c0bf5-bb80-4f6f-94a5-b6cb5c087a88 None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:53.611548 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c0bf5-bb80-4f6f-94a5-b6cb5c087a88 None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:53.643679 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b68e9-bc77-47e2-96a7-3ed794cefbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:53.644265 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b68e9-bc77-47e2-96a7-3ed794cefbea None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:53.644573 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b68e9-bc77-47e2-96a7-3ed794cefbea None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:53.644850 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b68e9-bc77-47e2-96a7-3ed794cefbea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:53.645552 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b68e9-bc77-47e2-96a7-3ed794cefbea None admin] RBAC: Adding query filter params (role.id=e154509f216e4ae59f74044aa234ddde, scope.project.id=b09192159c884e73bef832a38e2d5e7c, user.id=366baacae7c143929a64f5b639c17a99) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:53.645858 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b68e9-bc77-47e2-96a7-3ed794cefbea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:53.647288 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b68e9-bc77-47e2-96a7-3ed794cefbea None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:53.652778 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 465/908] 10.222.0.43 () {56 vars in 1374 bytes} [Fri Aug 19 03:53:53 2022] GET /identity/v3/role_assignments?user.id=366baacae7c143929a64f5b639c17a99&scope.project.id=b09192159c884e73bef832a38e2d5e7c&role.id=e154509f216e4ae59f74044aa234ddde => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:55.792950 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b8716-d494-4110-a646-527474727ce4 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:55.793486 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b8716-d494-4110-a646-527474727ce4 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:55.793486 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b8716-d494-4110-a646-527474727ce4 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:55.794817 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 444/909] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:53:55.799957 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9dfa6-ae78-4f4e-8c98-45e753cc5457 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:55.801017 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9dfa6-ae78-4f4e-8c98-45e753cc5457 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:55.801111 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9dfa6-ae78-4f4e-8c98-45e753cc5457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:55.819121 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-82d9dfa6-ae78-4f4e-8c98-45e753cc5457 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:53:55.820357 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-82d9dfa6-ae78-4f4e-8c98-45e753cc5457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:53:55.852515 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:55.891353 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 466/910] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:53:55 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 03:53:56.216680 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b8716-d494-4110-a646-527474727ce4 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:56.316247 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b8716-d494-4110-a646-527474727ce4 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:56.324113 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:56.351642 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692fc83-cc46-4fac-9d6d-820b4bc56129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:56.352268 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692fc83-cc46-4fac-9d6d-820b4bc56129 None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:56.352581 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692fc83-cc46-4fac-9d6d-820b4bc56129 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:56.352859 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692fc83-cc46-4fac-9d6d-820b4bc56129 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:56.353441 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692fc83-cc46-4fac-9d6d-820b4bc56129 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:56.354801 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692fc83-cc46-4fac-9d6d-820b4bc56129 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:56.363351 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-a692fc83-cc46-4fac-9d6d-820b4bc56129 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 03:53:56.363351 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:56.363351 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 03:53:56.363351 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 03:53:56.363351 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 03:53:56.363351 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 03:53:56.363351 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 03:53:56.363351 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:53:56.363351 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 03:53:56.363351 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:53:56.363351 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 03:53:56.363351 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:53:56.363351 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:53:56.363351 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:53:56.363351 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:53:56.363351 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:53:56.363351 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:53:56.364546 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:53:56.364546 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:53:56.364546 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:53:56.364546 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:53:56.364546 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:53:56.364546 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:53:56.364546 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 03:53:56.364546 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 03:53:56.364546 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 03:53:56.364546 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 03:53:56.364546 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:53:56.364546 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:53:56.364546 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:53:56.364546 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:53:56.364546 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:53:56.364546 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:53:56.365891 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:53:56.365891 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:53:56.365891 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:53:56.365891 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:53:56.365891 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:53:56.365891 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:53:56.365891 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:53:56.365891 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:53:56.365891 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:53:56.365891 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:53:56.365891 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 03:53:56.365891 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:53:56.365891 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 03:53:56.365891 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:53:56.365891 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 445/911] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Aug 19 03:53:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:53:56.370742 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9dfa6-ae78-4f4e-8c98-45e753cc5457 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:56.464326 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9dfa6-ae78-4f4e-8c98-45e753cc5457 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:56.496883 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5247e4-bf20-45ff-9ddd-f83d461ce434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:56.497475 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5247e4-bf20-45ff-9ddd-f83d461ce434 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:56.497760 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5247e4-bf20-45ff-9ddd-f83d461ce434 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:56.498037 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5247e4-bf20-45ff-9ddd-f83d461ce434 None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:56.498650 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5247e4-bf20-45ff-9ddd-f83d461ce434 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:56.498952 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5247e4-bf20-45ff-9ddd-f83d461ce434 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:56.500313 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5247e4-bf20-45ff-9ddd-f83d461ce434 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:56.505329 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 467/912] 10.222.0.43 () {56 vars in 1116 bytes} [Fri Aug 19 03:53:56 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:56.510950 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692fc83-cc46-4fac-9d6d-820b4bc56129 None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:56.607075 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692fc83-cc46-4fac-9d6d-820b4bc56129 None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:56.639435 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895fc2f-945a-4f87-ba0b-b793bf00c50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:56.640018 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895fc2f-945a-4f87-ba0b-b793bf00c50c None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:56.640297 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895fc2f-945a-4f87-ba0b-b793bf00c50c None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:56.640598 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895fc2f-945a-4f87-ba0b-b793bf00c50c None admin] PATH_INFO: `/v3/services` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:56.641213 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895fc2f-945a-4f87-ba0b-b793bf00c50c None admin] RBAC: Adding query filter params (type=placement) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:53:56.641512 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895fc2f-945a-4f87-ba0b-b793bf00c50c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:56.642859 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895fc2f-945a-4f87-ba0b-b793bf00c50c None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:56.647648 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 446/913] 10.222.0.43 () {56 vars in 1116 bytes} [Fri Aug 19 03:53:56 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:53:58.774383 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469f397-d472-439e-a4e5-e7804295aea0 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:58.774939 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469f397-d472-439e-a4e5-e7804295aea0 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:58.774939 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469f397-d472-439e-a4e5-e7804295aea0 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:58.776235 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 468/914] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:53:58.781437 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2122d6d-df90-4d1e-ae7e-d62e4e30cafe None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:58.781843 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2122d6d-df90-4d1e-ae7e-d62e4e30cafe None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:58.781992 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2122d6d-df90-4d1e-ae7e-d62e4e30cafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:58.800720 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-c2122d6d-df90-4d1e-ae7e-d62e4e30cafe None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:53:58.801911 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-c2122d6d-df90-4d1e-ae7e-d62e4e30cafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:53:58.831321 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:58.875023 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 447/915] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:53:58 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 03:53:59.197581 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469f397-d472-439e-a4e5-e7804295aea0 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:53:59.228858 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:53:59.296765 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469f397-d472-439e-a4e5-e7804295aea0 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:53:59.328961 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09186e1a-2e06-4ddf-9caf-c7a68c1002f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:53:59.329587 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09186e1a-2e06-4ddf-9caf-c7a68c1002f3 None admin] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:53:59.329872 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09186e1a-2e06-4ddf-9caf-c7a68c1002f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:53:59.330151 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09186e1a-2e06-4ddf-9caf-c7a68c1002f3 None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:53:59.331302 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09186e1a-2e06-4ddf-9caf-c7a68c1002f3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:53:59.332688 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09186e1a-2e06-4ddf-9caf-c7a68c1002f3 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:53:59.346950 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 469/916] 10.222.0.43 () {60 vars in 1141 bytes} [Fri Aug 19 03:53:59 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:54:01.468999 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe3f40-b89e-4305-81e1-13afc7e21f02 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:54:01.469520 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe3f40-b89e-4305-81e1-13afc7e21f02 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:54:01.469520 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe3f40-b89e-4305-81e1-13afc7e21f02 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:54:01.471371 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 448/917] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:54:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:54:01.476537 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa1113-2498-4e76-bcd3-6c5df2f7056e None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:54:01.476933 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa1113-2498-4e76-bcd3-6c5df2f7056e None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:54:01.477100 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa1113-2498-4e76-bcd3-6c5df2f7056e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:54:01.495507 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-a1aa1113-2498-4e76-bcd3-6c5df2f7056e None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:54:01.496785 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-a1aa1113-2498-4e76-bcd3-6c5df2f7056e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:54:01.566218 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 470/918] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:54:01 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 03:54:01.889949 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe3f40-b89e-4305-81e1-13afc7e21f02 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:54:01.987966 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe3f40-b89e-4305-81e1-13afc7e21f02 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:54:02.020998 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8214b-7857-4d56-97b0-501908cda45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:54:02.021606 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8214b-7857-4d56-97b0-501908cda45a None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:54:02.021879 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8214b-7857-4d56-97b0-501908cda45a None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:54:02.022147 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8214b-7857-4d56-97b0-501908cda45a None admin] PATH_INFO: `/v3/services/placement` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:54:02.022708 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8214b-7857-4d56-97b0-501908cda45a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:54:02.024052 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8214b-7857-4d56-97b0-501908cda45a None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:54:02.032350 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-13a8214b-7857-4d56-97b0-501908cda45a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 03:54:02.032350 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:54:02.032350 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 03:54:02.032350 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 03:54:02.032350 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 03:54:02.032350 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 03:54:02.032350 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 03:54:02.032350 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:54:02.032350 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 03:54:02.032350 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:54:02.032350 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 03:54:02.032350 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:54:02.032350 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:54:02.032350 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:54:02.032350 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:54:02.032350 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:54:02.032350 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:54:02.033632 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:54:02.033632 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:54:02.033632 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:54:02.033632 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:54:02.033632 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:54:02.033632 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:54:02.033632 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 03:54:02.033632 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 03:54:02.033632 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 03:54:02.033632 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 03:54:02.033632 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:54:02.033632 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:54:02.033632 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:54:02.033632 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:54:02.033632 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:54:02.033632 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:54:02.034763 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:54:02.034763 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:54:02.034763 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:54:02.034763 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:54:02.034763 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:54:02.034763 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:54:02.034763 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:54:02.034763 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:54:02.034763 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:54:02.034763 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:54:02.034763 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 03:54:02.034763 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:54:02.034763 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 03:54:02.034763 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:54:02.034763 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 449/919] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Aug 19 03:54:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:54:02.039263 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa1113-2498-4e76-bcd3-6c5df2f7056e None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:54:02.057151 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:54:02.136648 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa1113-2498-4e76-bcd3-6c5df2f7056e None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:54:02.168784 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b7564-9060-4457-ae33-bfffbebb591d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:54:02.169329 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b7564-9060-4457-ae33-bfffbebb591d None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:54:02.169610 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b7564-9060-4457-ae33-bfffbebb591d None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:54:02.169882 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b7564-9060-4457-ae33-bfffbebb591d None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:54:02.170504 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b7564-9060-4457-ae33-bfffbebb591d None admin] RBAC: Adding query filter params (name=placement) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:54:02.170841 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b7564-9060-4457-ae33-bfffbebb591d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:54:02.172211 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b7564-9060-4457-ae33-bfffbebb591d None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:54:02.178294 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 471/920] 10.222.0.43 () {56 vars in 1116 bytes} [Fri Aug 19 03:54:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:54:02.184105 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8214b-7857-4d56-97b0-501908cda45a None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:54:02.212163 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:54:02.281069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8214b-7857-4d56-97b0-501908cda45a None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:54:02.313579 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1173ac6-ac6e-42b7-9b82-11e50e46a1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:54:02.314171 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1173ac6-ac6e-42b7-9b82-11e50e46a1ab None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:54:02.315108 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1173ac6-ac6e-42b7-9b82-11e50e46a1ab None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:54:02.315387 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1173ac6-ac6e-42b7-9b82-11e50e46a1ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:54:02.316074 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1173ac6-ac6e-42b7-9b82-11e50e46a1ab None admin] RBAC: Adding query filter params (interface=public, service_id=b82da030bba247038fdaf7bc574fdba4, region_id=RegionOne) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:54:02.316378 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1173ac6-ac6e-42b7-9b82-11e50e46a1ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:54:02.317759 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1173ac6-ac6e-42b7-9b82-11e50e46a1ab None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:54:02.322598 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 450/921] 10.222.0.43 () {56 vars in 1251 bytes} [Fri Aug 19 03:54:02 2022] GET /identity/v3/endpoints?service_id=b82da030bba247038fdaf7bc574fdba4&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:54:02.328205 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b7564-9060-4457-ae33-bfffbebb591d None admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:54:02.406614 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:54:02.424594 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b7564-9060-4457-ae33-bfffbebb591d None admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:54:02.456845 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91224415-2df1-44fc-abe6-4f2724469e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:54:02.457439 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91224415-2df1-44fc-abe6-4f2724469e54 None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:54:02.457718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91224415-2df1-44fc-abe6-4f2724469e54 None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:54:02.457990 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91224415-2df1-44fc-abe6-4f2724469e54 None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:54:02.458583 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91224415-2df1-44fc-abe6-4f2724469e54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:54:02.459944 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91224415-2df1-44fc-abe6-4f2724469e54 None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:54:02.466138 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 472/922] 10.222.0.43 () {56 vars in 1087 bytes} [Fri Aug 19 03:54:02 2022] GET /identity/v3/services => generated 1962 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 03:54:04.587193 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff253c-94e2-4ca5-9b24-233ec81ea2ac None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:54:04.587686 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff253c-94e2-4ca5-9b24-233ec81ea2ac None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:54:04.587686 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff253c-94e2-4ca5-9b24-233ec81ea2ac None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:54:04.589032 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 451/923] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:54:04.594186 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8018f3-b512-48c2-9dc7-519e6d67a603 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:54:04.594570 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8018f3-b512-48c2-9dc7-519e6d67a603 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:54:04.594732 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8018f3-b512-48c2-9dc7-519e6d67a603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:54:04.612775 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-fd8018f3-b512-48c2-9dc7-519e6d67a603 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:54:04.614195 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-fd8018f3-b512-48c2-9dc7-519e6d67a603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:54:04.676854 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 473/924] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:54:04 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 03:54:05.004115 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff253c-94e2-4ca5-9b24-233ec81ea2ac None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:54:05.093190 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:54:05.102849 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff253c-94e2-4ca5-9b24-233ec81ea2ac None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:54:05.136238 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f45b66-9426-4463-ab46-885bf0bbb7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:54:05.136882 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f45b66-9426-4463-ab46-885bf0bbb7cd None admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:54:05.137162 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f45b66-9426-4463-ab46-885bf0bbb7cd None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:54:05.137432 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f45b66-9426-4463-ab46-885bf0bbb7cd None admin] PATH_INFO: `/v3/services/placement` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:54:05.138001 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f45b66-9426-4463-ab46-885bf0bbb7cd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:54:05.139394 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f45b66-9426-4463-ab46-885bf0bbb7cd None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:54:05.148075 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application [None req-92f45b66-9426-4463-ab46-885bf0bbb7cd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 03:54:05.148075 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:54:05.148075 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 03:54:05.148075 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 03:54:05.148075 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 03:54:05.148075 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 03:54:05.148075 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 03:54:05.148075 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:54:05.148075 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 03:54:05.148075 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:54:05.148075 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 03:54:05.148075 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:54:05.148075 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 03:54:05.148075 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 03:54:05.148075 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 03:54:05.148075 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 03:54:05.148075 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 03:54:05.149262 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 03:54:05.149262 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 03:54:05.149262 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 03:54:05.149262 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 03:54:05.149262 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 03:54:05.149262 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 03:54:05.149262 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 03:54:05.149262 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 03:54:05.149262 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 03:54:05.149262 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 03:54:05.149262 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 03:54:05.149262 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 03:54:05.149262 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 03:54:05.149262 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 03:54:05.149262 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 03:54:05.149262 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 03:54:05.150267 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 03:54:05.150267 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application with Lock( Aug 19 03:54:05.150267 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 03:54:05.150267 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self._enter() Aug 19 03:54:05.150267 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 03:54:05.150267 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 03:54:05.150267 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 03:54:05.150267 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application return self.creator() Aug 19 03:54:05.150267 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 03:54:05.150267 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application created_value = creator( Aug 19 03:54:05.150267 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 03:54:05.150267 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 03:54:05.150267 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 03:54:05.150267 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: ERROR keystone.server.flask.application Aug 19 03:54:05.150267 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 452/925] 10.222.0.43 () {56 vars in 1117 bytes} [Fri Aug 19 03:54:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 03:54:05.155102 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8018f3-b512-48c2-9dc7-519e6d67a603 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:54:05.227090 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:54:05.249736 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8018f3-b512-48c2-9dc7-519e6d67a603 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:54:05.281911 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4919e-93da-4fd3-a81f-ad516869992c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:54:05.282473 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4919e-93da-4fd3-a81f-ad516869992c None admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:54:05.282750 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4919e-93da-4fd3-a81f-ad516869992c None admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:54:05.283022 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4919e-93da-4fd3-a81f-ad516869992c None admin] PATH_INFO: `/v3/services` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:54:05.283638 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4919e-93da-4fd3-a81f-ad516869992c None admin] RBAC: Adding query filter params (name=placement) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:54:05.283936 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4919e-93da-4fd3-a81f-ad516869992c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:54:05.285324 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4919e-93da-4fd3-a81f-ad516869992c None admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:54:05.290076 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 474/926] 10.222.0.43 () {56 vars in 1116 bytes} [Fri Aug 19 03:54:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:54:05.295816 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f45b66-9426-4463-ab46-885bf0bbb7cd None admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:54:05.395107 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f45b66-9426-4463-ab46-885bf0bbb7cd None admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:54:05.427548 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498fcaa-3e0a-482e-b059-af738280e521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:54:05.428141 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498fcaa-3e0a-482e-b059-af738280e521 None admin] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:54:05.428420 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498fcaa-3e0a-482e-b059-af738280e521 None admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:54:05.428723 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498fcaa-3e0a-482e-b059-af738280e521 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:54:05.429370 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498fcaa-3e0a-482e-b059-af738280e521 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:54:05.430717 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498fcaa-3e0a-482e-b059-af738280e521 None admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:54:05.450177 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 453/927] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 03:54:05 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:54:15.287334 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=30 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:54:15.446057 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:55:04.089935 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6462d38-c6ad-46d3-9f9e-6e3d88e98f14 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:04.090608 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6462d38-c6ad-46d3-9f9e-6e3d88e98f14 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:04.090879 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6462d38-c6ad-46d3-9f9e-6e3d88e98f14 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:04.096298 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 475/928] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:55:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:55:04.097777 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92964eaa-2201-485a-9d31-b72e96542eee None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:04.098212 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92964eaa-2201-485a-9d31-b72e96542eee None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:04.098416 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92964eaa-2201-485a-9d31-b72e96542eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:04.119864 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-92964eaa-2201-485a-9d31-b72e96542eee None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:55:04.121147 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-92964eaa-2201-485a-9d31-b72e96542eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:55:04.249492 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 454/929] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:55:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 03:55:04.604925 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02568594-d284-4f3f-a33a-1513e6355de0 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:04.604925 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02568594-d284-4f3f-a33a-1513e6355de0 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:04.604925 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02568594-d284-4f3f-a33a-1513e6355de0 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:04.606281 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 476/930] 10.222.0.43 () {54 vars in 965 bytes} [Fri Aug 19 03:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:55:04.613064 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410e355-8198-4f27-be92-4d892e41e13b None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:04.613577 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410e355-8198-4f27-be92-4d892e41e13b None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:04.614035 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410e355-8198-4f27-be92-4d892e41e13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:04.683079 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-1410e355-8198-4f27-be92-4d892e41e13b None None] MFA Rules not processed for user `00454605826e4d6593d2d6aa331ebdc6`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:55:04.685042 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-1410e355-8198-4f27-be92-4d892e41e13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:55:04.762402 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 455/931] 10.222.0.43 () {58 vars in 1062 bytes} [Fri Aug 19 03:55:04 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:55:04.770945 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02568594-d284-4f3f-a33a-1513e6355de0 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:55:04.781695 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02568594-d284-4f3f-a33a-1513e6355de0 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:55:04.785889 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86d89f-764c-464d-8802-06331dc4f42c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:55:04.786552 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86d89f-764c-464d-8802-06331dc4f42c service neutron] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:04.786899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86d89f-764c-464d-8802-06331dc4f42c service neutron] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:04.787239 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86d89f-764c-464d-8802-06331dc4f42c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:04.797681 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86d89f-764c-464d-8802-06331dc4f42c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:55:04.799203 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86d89f-764c-464d-8802-06331dc4f42c service neutron] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:55:04.810575 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 477/932] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:55:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:55:07.213054 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1ff68-e124-4cad-a6b5-9f3559b4858c None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:07.213536 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1ff68-e124-4cad-a6b5-9f3559b4858c None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:07.213640 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1ff68-e124-4cad-a6b5-9f3559b4858c None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:07.214950 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 456/933] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:55:07.220105 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f48488-c1ad-4f8a-b2c7-ad58eb68a95b None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:07.220555 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f48488-c1ad-4f8a-b2c7-ad58eb68a95b None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:07.220683 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f48488-c1ad-4f8a-b2c7-ad58eb68a95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:07.239584 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-36f48488-c1ad-4f8a-b2c7-ad58eb68a95b None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:55:07.240797 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-36f48488-c1ad-4f8a-b2c7-ad58eb68a95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:55:07.248376 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 478/934] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:55:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:55:07.593152 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1ff68-e124-4cad-a6b5-9f3559b4858c None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:55:07.604730 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1ff68-e124-4cad-a6b5-9f3559b4858c None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:55:07.608265 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c19cb-423f-4561-bbef-3db56b3bf70b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:55:07.608909 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c19cb-423f-4561-bbef-3db56b3bf70b service neutron] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:07.609190 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c19cb-423f-4561-bbef-3db56b3bf70b service neutron] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:07.609465 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c19cb-423f-4561-bbef-3db56b3bf70b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:07.619250 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c19cb-423f-4561-bbef-3db56b3bf70b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:55:07.620802 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c19cb-423f-4561-bbef-3db56b3bf70b service neutron] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:55:07.632288 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 457/935] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:55:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:55:10.117091 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933a72c-c153-4227-b065-10b1ed3cdf96 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:10.117653 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933a72c-c153-4227-b065-10b1ed3cdf96 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:10.117653 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933a72c-c153-4227-b065-10b1ed3cdf96 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:10.119124 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 479/936] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 03:55:10.123969 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc34a5-d21b-431f-8ea1-2c370a5378d7 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:10.124352 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc34a5-d21b-431f-8ea1-2c370a5378d7 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:10.124591 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc34a5-d21b-431f-8ea1-2c370a5378d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:10.165226 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-53fc34a5-d21b-431f-8ea1-2c370a5378d7 None None] MFA Rules not processed for user `20953f4ef7cb44fe9392681065db4996`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:55:10.166810 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-53fc34a5-d21b-431f-8ea1-2c370a5378d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:55:10.214510 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:55:10.243739 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 458/937] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:55:10 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:55:10.596103 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e78bb-977a-47a6-b3c1-e5213161fdfb None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:10.596405 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e78bb-977a-47a6-b3c1-e5213161fdfb None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:10.596875 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e78bb-977a-47a6-b3c1-e5213161fdfb None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:10.598410 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 480/938] 10.222.0.43 () {54 vars in 965 bytes} [Fri Aug 19 03:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:55:10.604553 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8a976-4db3-494d-ad56-bf7da8bb89c5 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:10.604909 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8a976-4db3-494d-ad56-bf7da8bb89c5 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:10.605427 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8a976-4db3-494d-ad56-bf7da8bb89c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:10.626552 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-5fa8a976-4db3-494d-ad56-bf7da8bb89c5 None None] MFA Rules not processed for user `00454605826e4d6593d2d6aa331ebdc6`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:55:10.628408 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-5fa8a976-4db3-494d-ad56-bf7da8bb89c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:55:10.635442 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 459/939] 10.222.0.43 () {58 vars in 1062 bytes} [Fri Aug 19 03:55:10 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:55:10.644965 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e78bb-977a-47a6-b3c1-e5213161fdfb None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:55:10.655842 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e78bb-977a-47a6-b3c1-e5213161fdfb None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:55:10.659610 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9b100-753c-40b1-81f9-402e38452b56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:55:10.660432 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9b100-753c-40b1-81f9-402e38452b56 service neutron] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:10.660987 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9b100-753c-40b1-81f9-402e38452b56 service neutron] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:10.661463 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9b100-753c-40b1-81f9-402e38452b56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:10.670677 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9b100-753c-40b1-81f9-402e38452b56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:55:10.672332 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9b100-753c-40b1-81f9-402e38452b56 service neutron] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:55:10.682545 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 481/940] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:55:10 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:55:13.833993 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1728f4-7ae4-4d1b-b3d3-f04ccdee83f1 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:13.834556 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1728f4-7ae4-4d1b-b3d3-f04ccdee83f1 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:13.834556 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1728f4-7ae4-4d1b-b3d3-f04ccdee83f1 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:13.835827 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 460/941] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:55:13.840855 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efdd46d-603b-42e1-837e-8194f2b9a93b None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:13.841300 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efdd46d-603b-42e1-837e-8194f2b9a93b None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:13.841409 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efdd46d-603b-42e1-837e-8194f2b9a93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:13.860584 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-1efdd46d-603b-42e1-837e-8194f2b9a93b None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:55:13.861780 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-1efdd46d-603b-42e1-837e-8194f2b9a93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:55:13.927144 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 482/942] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:55:13 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:55:14.264985 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1728f4-7ae4-4d1b-b3d3-f04ccdee83f1 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:55:14.275427 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1728f4-7ae4-4d1b-b3d3-f04ccdee83f1 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:55:14.278870 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09409e-78cf-4a0b-853b-e25c2916748e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:55:14.279456 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09409e-78cf-4a0b-853b-e25c2916748e service neutron] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:14.279732 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09409e-78cf-4a0b-853b-e25c2916748e service neutron] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:14.280003 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09409e-78cf-4a0b-853b-e25c2916748e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:14.289049 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09409e-78cf-4a0b-853b-e25c2916748e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:55:14.290469 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09409e-78cf-4a0b-853b-e25c2916748e service neutron] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:55:14.299660 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 461/943] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:55:14 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:55:17.112794 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74951823-e4b9-40f2-ba59-f89d5fc449f8 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:17.113356 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74951823-e4b9-40f2-ba59-f89d5fc449f8 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:17.113356 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74951823-e4b9-40f2-ba59-f89d5fc449f8 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:17.114659 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 483/944] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:55:17.120422 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d6b60-0335-42a8-a8f7-452e20a2c16c None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:17.120845 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d6b60-0335-42a8-a8f7-452e20a2c16c None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:17.121063 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d6b60-0335-42a8-a8f7-452e20a2c16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:17.139649 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-e41d6b60-0335-42a8-a8f7-452e20a2c16c None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:55:17.140853 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-e41d6b60-0335-42a8-a8f7-452e20a2c16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:55:17.148426 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 462/945] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:55:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:55:17.484051 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74951823-e4b9-40f2-ba59-f89d5fc449f8 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:55:17.494941 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74951823-e4b9-40f2-ba59-f89d5fc449f8 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:55:17.498845 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef286b-e262-4b97-9a1c-4ada9dc2b375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:55:17.499444 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef286b-e262-4b97-9a1c-4ada9dc2b375 service neutron] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:17.499724 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef286b-e262-4b97-9a1c-4ada9dc2b375 service neutron] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:17.500000 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef286b-e262-4b97-9a1c-4ada9dc2b375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:17.508804 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef286b-e262-4b97-9a1c-4ada9dc2b375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:55:17.510244 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef286b-e262-4b97-9a1c-4ada9dc2b375 service neutron] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:55:17.520094 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 484/946] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:55:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:55:19.862169 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171b931-760e-4d0c-8379-7f2959b00fc8 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:19.862679 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171b931-760e-4d0c-8379-7f2959b00fc8 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:19.862785 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171b931-760e-4d0c-8379-7f2959b00fc8 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:19.864420 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 463/947] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:55:19.870176 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817def5-0d7a-4606-ad15-f61f4238e5db None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:19.870612 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817def5-0d7a-4606-ad15-f61f4238e5db None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:19.870784 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817def5-0d7a-4606-ad15-f61f4238e5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:19.891891 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-c817def5-0d7a-4606-ad15-f61f4238e5db None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:55:19.893133 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-c817def5-0d7a-4606-ad15-f61f4238e5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:55:19.901183 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 485/948] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:55:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:55:20.239821 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171b931-760e-4d0c-8379-7f2959b00fc8 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:55:20.250789 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171b931-760e-4d0c-8379-7f2959b00fc8 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:55:20.254235 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f634c-ffe7-436c-882f-5312d0ee2d86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:55:20.254820 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f634c-ffe7-436c-882f-5312d0ee2d86 service neutron] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:20.255093 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f634c-ffe7-436c-882f-5312d0ee2d86 service neutron] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:20.255362 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f634c-ffe7-436c-882f-5312d0ee2d86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:20.264314 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f634c-ffe7-436c-882f-5312d0ee2d86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:55:20.265761 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f634c-ffe7-436c-882f-5312d0ee2d86 service neutron] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:55:20.275217 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 464/949] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:55:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:55:22.493431 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b79170-11ba-4129-a267-67721bd3a4ab None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:22.493890 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b79170-11ba-4129-a267-67721bd3a4ab None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:22.493984 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b79170-11ba-4129-a267-67721bd3a4ab None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:22.495326 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 486/950] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:55:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:55:22.500520 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2358b7d-6fcf-4ed9-b291-ace21a382569 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:22.500926 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2358b7d-6fcf-4ed9-b291-ace21a382569 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:22.501208 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2358b7d-6fcf-4ed9-b291-ace21a382569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:22.521197 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-c2358b7d-6fcf-4ed9-b291-ace21a382569 None None] MFA Rules not processed for user `20953f4ef7cb44fe9392681065db4996`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:55:22.522473 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-c2358b7d-6fcf-4ed9-b291-ace21a382569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:55:22.531247 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 465/951] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:55:22 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 03:55:22.863607 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b79170-11ba-4129-a267-67721bd3a4ab None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:55:22.874652 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b79170-11ba-4129-a267-67721bd3a4ab None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:55:22.878080 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba66959-d819-46c7-82d9-1389a5c0c7a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:55:22.878659 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba66959-d819-46c7-82d9-1389a5c0c7a4 service neutron] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:22.878934 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba66959-d819-46c7-82d9-1389a5c0c7a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:22.879202 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba66959-d819-46c7-82d9-1389a5c0c7a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:22.888344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba66959-d819-46c7-82d9-1389a5c0c7a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:55:22.889787 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba66959-d819-46c7-82d9-1389a5c0c7a4 service neutron] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:55:22.899199 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 487/952] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:55:22 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:55:25.290888 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741c3ff-1da5-4ab4-affc-2c36fd77a472 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:25.291417 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741c3ff-1da5-4ab4-affc-2c36fd77a472 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:25.291417 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741c3ff-1da5-4ab4-affc-2c36fd77a472 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:25.292795 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 466/953] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:55:25.297886 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea13899-3194-4306-9c0a-da9a15b46135 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:25.298310 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea13899-3194-4306-9c0a-da9a15b46135 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:25.298417 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea13899-3194-4306-9c0a-da9a15b46135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:25.305673 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=62 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:55:25.319065 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-cea13899-3194-4306-9c0a-da9a15b46135 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:55:25.320276 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-cea13899-3194-4306-9c0a-da9a15b46135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:55:25.328814 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 488/954] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:55:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:55:25.669527 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741c3ff-1da5-4ab4-affc-2c36fd77a472 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:55:25.680629 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741c3ff-1da5-4ab4-affc-2c36fd77a472 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:55:25.684056 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38452e21-2c6a-4ef3-a082-23b91b7687af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:55:25.684685 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38452e21-2c6a-4ef3-a082-23b91b7687af service neutron] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:25.684962 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38452e21-2c6a-4ef3-a082-23b91b7687af service neutron] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:25.685233 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38452e21-2c6a-4ef3-a082-23b91b7687af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:25.696162 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38452e21-2c6a-4ef3-a082-23b91b7687af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:55:25.697744 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38452e21-2c6a-4ef3-a082-23b91b7687af service neutron] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:55:25.707555 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 467/955] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:55:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:55:27.942318 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a63d3c-e785-45b8-8929-10ffb66c4d9b None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:27.942871 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a63d3c-e785-45b8-8929-10ffb66c4d9b None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:27.942871 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a63d3c-e785-45b8-8929-10ffb66c4d9b None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:27.944197 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 489/956] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:55:27.949581 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd5e6f-0d13-4c68-91f9-38025061c3f2 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:27.950027 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd5e6f-0d13-4c68-91f9-38025061c3f2 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:27.950139 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd5e6f-0d13-4c68-91f9-38025061c3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:27.969853 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-b9cd5e6f-0d13-4c68-91f9-38025061c3f2 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:55:27.971025 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-b9cd5e6f-0d13-4c68-91f9-38025061c3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:55:27.978640 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 468/957] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:55:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 03:55:28.329298 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a63d3c-e785-45b8-8929-10ffb66c4d9b None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:55:28.340476 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a63d3c-e785-45b8-8929-10ffb66c4d9b None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:55:28.344239 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f56ec-ef7a-4173-9a26-d190ee4079bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:55:28.344901 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f56ec-ef7a-4173-9a26-d190ee4079bb service neutron] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:28.345179 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f56ec-ef7a-4173-9a26-d190ee4079bb service neutron] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:28.345449 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f56ec-ef7a-4173-9a26-d190ee4079bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:28.355403 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f56ec-ef7a-4173-9a26-d190ee4079bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:55:28.356892 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f56ec-ef7a-4173-9a26-d190ee4079bb service neutron] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:55:28.367468 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 490/958] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:55:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:55:30.854369 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6341d0f-8437-4a59-8cc1-b472143ac9aa None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:30.854922 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6341d0f-8437-4a59-8cc1-b472143ac9aa None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:30.854922 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6341d0f-8437-4a59-8cc1-b472143ac9aa None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:30.856608 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 469/959] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:55:30.862001 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351c790-876c-4b7b-9692-82ff2a5a5dd1 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:30.862401 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351c790-876c-4b7b-9692-82ff2a5a5dd1 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:30.862585 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351c790-876c-4b7b-9692-82ff2a5a5dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:30.882451 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-3351c790-876c-4b7b-9692-82ff2a5a5dd1 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:55:30.883657 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-3351c790-876c-4b7b-9692-82ff2a5a5dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:55:30.891490 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 491/960] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:55:30 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:55:31.230232 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6341d0f-8437-4a59-8cc1-b472143ac9aa None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:55:31.241347 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6341d0f-8437-4a59-8cc1-b472143ac9aa None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:55:31.244772 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60f69c-4c39-439f-8f14-11bb924452a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:55:31.245356 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60f69c-4c39-439f-8f14-11bb924452a6 service neutron] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:31.245631 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60f69c-4c39-439f-8f14-11bb924452a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:31.245902 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60f69c-4c39-439f-8f14-11bb924452a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:31.254447 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60f69c-4c39-439f-8f14-11bb924452a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:55:31.255865 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60f69c-4c39-439f-8f14-11bb924452a6 service neutron] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:55:31.264872 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 470/961] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:55:31 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:55:35.307255 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daffeb3-5c8f-4315-94ef-3618f9556e45 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:35.307775 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daffeb3-5c8f-4315-94ef-3618f9556e45 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:35.307775 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daffeb3-5c8f-4315-94ef-3618f9556e45 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:35.309101 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 492/962] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:55:35.314159 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359857b-b8e8-446f-a82a-b9272f319661 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:35.314569 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359857b-b8e8-446f-a82a-b9272f319661 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:35.314686 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359857b-b8e8-446f-a82a-b9272f319661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:35.333941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-0359857b-b8e8-446f-a82a-b9272f319661 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:55:35.335129 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-0359857b-b8e8-446f-a82a-b9272f319661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:55:35.343148 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 471/963] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:55:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:55:35.680304 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daffeb3-5c8f-4315-94ef-3618f9556e45 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:55:35.691110 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daffeb3-5c8f-4315-94ef-3618f9556e45 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:55:35.695066 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37d9d4-0eba-4b4a-9ea5-bd0cca6bd0d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:55:35.695652 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37d9d4-0eba-4b4a-9ea5-bd0cca6bd0d2 service neutron] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:35.695928 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37d9d4-0eba-4b4a-9ea5-bd0cca6bd0d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:35.696192 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37d9d4-0eba-4b4a-9ea5-bd0cca6bd0d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:35.704955 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37d9d4-0eba-4b4a-9ea5-bd0cca6bd0d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:55:35.706386 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37d9d4-0eba-4b4a-9ea5-bd0cca6bd0d2 service neutron] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:55:35.716264 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 493/964] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:55:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:55:38.523523 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394612f2-cee3-45b0-a8d2-29347f964e2c None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:38.524051 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394612f2-cee3-45b0-a8d2-29347f964e2c None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:38.524051 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394612f2-cee3-45b0-a8d2-29347f964e2c None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:38.525323 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 472/965] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:55:38.530810 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80cb56-224a-47a7-8000-416e47bd0d44 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:38.531192 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80cb56-224a-47a7-8000-416e47bd0d44 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:38.531372 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80cb56-224a-47a7-8000-416e47bd0d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:38.550730 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-6f80cb56-224a-47a7-8000-416e47bd0d44 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:55:38.551933 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-6f80cb56-224a-47a7-8000-416e47bd0d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:55:38.560246 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 494/966] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:55:38 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:55:38.903453 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394612f2-cee3-45b0-a8d2-29347f964e2c None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:55:38.914870 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394612f2-cee3-45b0-a8d2-29347f964e2c None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:55:38.918395 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bae71c-3b19-4066-b4b4-926dee31bcd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:55:38.918989 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bae71c-3b19-4066-b4b4-926dee31bcd5 service neutron] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:38.919267 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bae71c-3b19-4066-b4b4-926dee31bcd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:38.919542 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bae71c-3b19-4066-b4b4-926dee31bcd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:38.928544 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bae71c-3b19-4066-b4b4-926dee31bcd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:55:38.929983 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bae71c-3b19-4066-b4b4-926dee31bcd5 service neutron] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:55:38.939470 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 473/967] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:55:38 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:55:43.020287 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8035b3a-6bf3-4da4-bd5c-87287ba66709 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:43.020898 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8035b3a-6bf3-4da4-bd5c-87287ba66709 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:43.020898 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8035b3a-6bf3-4da4-bd5c-87287ba66709 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:43.022203 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 495/968] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:55:43.027518 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26077352-8c76-480c-a31b-61ab1ccc5391 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:43.027944 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26077352-8c76-480c-a31b-61ab1ccc5391 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:43.028074 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26077352-8c76-480c-a31b-61ab1ccc5391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:43.035685 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=57 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:55:43.048653 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-26077352-8c76-480c-a31b-61ab1ccc5391 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:55:43.049855 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-26077352-8c76-480c-a31b-61ab1ccc5391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:55:43.058348 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 474/969] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:55:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:55:43.402764 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8035b3a-6bf3-4da4-bd5c-87287ba66709 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:55:43.413643 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8035b3a-6bf3-4da4-bd5c-87287ba66709 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:55:43.417160 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c4586-b757-428f-93a2-5ffa2b26848b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:55:43.417749 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c4586-b757-428f-93a2-5ffa2b26848b service neutron] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:43.418027 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c4586-b757-428f-93a2-5ffa2b26848b service neutron] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:43.418300 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c4586-b757-428f-93a2-5ffa2b26848b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:43.426998 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c4586-b757-428f-93a2-5ffa2b26848b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:55:43.428366 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c4586-b757-428f-93a2-5ffa2b26848b service neutron] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:55:43.438175 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 496/970] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:55:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:55:48.828308 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd27f30-e049-4925-9825-5f293a7dc258 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:48.829315 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd27f30-e049-4925-9825-5f293a7dc258 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:48.831187 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd27f30-e049-4925-9825-5f293a7dc258 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:48.834549 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 475/971] 10.222.0.43 () {54 vars in 921 bytes} [Fri Aug 19 03:55:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:55:48.839395 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc992db7-36df-4dfc-b2ca-ae2cbf505101 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:48.839819 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc992db7-36df-4dfc-b2ca-ae2cbf505101 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:48.839947 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc992db7-36df-4dfc-b2ca-ae2cbf505101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:48.886914 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-fc992db7-36df-4dfc-b2ca-ae2cbf505101 None None] MFA Rules not processed for user `366baacae7c143929a64f5b639c17a99`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:55:48.888124 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-fc992db7-36df-4dfc-b2ca-ae2cbf505101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:55:48.969243 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 497/972] 10.222.0.43 () {58 vars in 1018 bytes} [Fri Aug 19 03:55:48 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:55:53.043979 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=2 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:55:53.531925 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d6229-7d7e-464b-b68b-4559b4c77fcd None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:53.532432 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d6229-7d7e-464b-b68b-4559b4c77fcd None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:53.532748 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d6229-7d7e-464b-b68b-4559b4c77fcd None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:53.534318 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 476/973] 10.222.0.43 () {54 vars in 921 bytes} [Fri Aug 19 03:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:55:53.539484 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e396775-c77c-476e-b9f4-94c8a372cd68 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:53.539970 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e396775-c77c-476e-b9f4-94c8a372cd68 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:53.540234 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e396775-c77c-476e-b9f4-94c8a372cd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:53.560475 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-4e396775-c77c-476e-b9f4-94c8a372cd68 None None] MFA Rules not processed for user `366baacae7c143929a64f5b639c17a99`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:55:53.561843 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-4e396775-c77c-476e-b9f4-94c8a372cd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:55:53.571014 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 498/974] 10.222.0.43 () {58 vars in 1018 bytes} [Fri Aug 19 03:55:53 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:55:55.140395 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5dfaea-2a37-4901-a48f-1b4eb4c9bde4 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:55.140991 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5dfaea-2a37-4901-a48f-1b4eb4c9bde4 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:55.140991 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5dfaea-2a37-4901-a48f-1b4eb4c9bde4 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:55.142384 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 477/975] 10.222.0.43 () {54 vars in 921 bytes} [Fri Aug 19 03:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:55:55.147504 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdfb84-c34c-4ca2-9a14-5d779c82dfc4 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:55.147911 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdfb84-c34c-4ca2-9a14-5d779c82dfc4 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:55.148078 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdfb84-c34c-4ca2-9a14-5d779c82dfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:55.167594 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-4cbdfb84-c34c-4ca2-9a14-5d779c82dfc4 None None] MFA Rules not processed for user `366baacae7c143929a64f5b639c17a99`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:55:55.168824 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-4cbdfb84-c34c-4ca2-9a14-5d779c82dfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:55:55.177897 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 499/976] 10.222.0.43 () {58 vars in 1018 bytes} [Fri Aug 19 03:55:55 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:55:59.038319 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32908f-df35-45ea-9b2f-d8728f8034aa None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:59.038854 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32908f-df35-45ea-9b2f-d8728f8034aa None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:59.038854 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32908f-df35-45ea-9b2f-d8728f8034aa None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:59.041803 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 478/977] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:55:59.046224 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052a43c-e3cf-4bd4-a965-65f4a5189a19 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:59.047099 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052a43c-e3cf-4bd4-a965-65f4a5189a19 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:59.047384 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052a43c-e3cf-4bd4-a965-65f4a5189a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:59.055552 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=72 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:55:59.071377 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-7052a43c-e3cf-4bd4-a965-65f4a5189a19 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:55:59.072747 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-7052a43c-e3cf-4bd4-a965-65f4a5189a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:55:59.088605 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 500/978] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:55:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:55:59.436704 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55836ae-3f0f-4d8f-924a-7e6b6c620fdf None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:59.437692 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55836ae-3f0f-4d8f-924a-7e6b6c620fdf None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:59.438300 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55836ae-3f0f-4d8f-924a-7e6b6c620fdf None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:59.442473 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 479/979] 10.222.0.43 () {54 vars in 962 bytes} [Fri Aug 19 03:55:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:55:59.449898 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f11ca9-2ebb-47bd-9abd-23215b3d677e None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:59.450414 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f11ca9-2ebb-47bd-9abd-23215b3d677e None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:59.450852 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f11ca9-2ebb-47bd-9abd-23215b3d677e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:59.491850 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-09f11ca9-2ebb-47bd-9abd-23215b3d677e None None] MFA Rules not processed for user `7aab3a88f9d0401db32fbaadef2711ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:55:59.493077 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-09f11ca9-2ebb-47bd-9abd-23215b3d677e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:55:59.566054 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 501/980] 10.222.0.43 () {58 vars in 1059 bytes} [Fri Aug 19 03:55:59 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:55:59.574128 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55836ae-3f0f-4d8f-924a-7e6b6c620fdf None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:55:59.588464 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55836ae-3f0f-4d8f-924a-7e6b6c620fdf None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:55:59.593397 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046080b-e39c-4df9-8bbf-eaa8af7e7ac6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:55:59.594025 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046080b-e39c-4df9-8bbf-eaa8af7e7ac6 service nova] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:55:59.594305 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046080b-e39c-4df9-8bbf-eaa8af7e7ac6 service nova] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:55:59.594598 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046080b-e39c-4df9-8bbf-eaa8af7e7ac6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:55:59.603722 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046080b-e39c-4df9-8bbf-eaa8af7e7ac6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:55:59.605382 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046080b-e39c-4df9-8bbf-eaa8af7e7ac6 service nova] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:55:59.615909 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 480/981] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:55:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:56:01.999195 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931a43c-ce25-45ce-8c9c-098bc3a1f935 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:01.999700 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931a43c-ce25-45ce-8c9c-098bc3a1f935 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:01.999700 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931a43c-ce25-45ce-8c9c-098bc3a1f935 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:02.001167 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 502/982] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:56:02.006703 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf8760-696c-44bb-b1e8-1d29ff03bf7d None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:02.007470 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf8760-696c-44bb-b1e8-1d29ff03bf7d None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:02.007756 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf8760-696c-44bb-b1e8-1d29ff03bf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:02.026970 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-6cbf8760-696c-44bb-b1e8-1d29ff03bf7d None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:02.028163 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-6cbf8760-696c-44bb-b1e8-1d29ff03bf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:02.036143 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 481/983] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:56:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:56:02.385913 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931a43c-ce25-45ce-8c9c-098bc3a1f935 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:56:02.400078 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931a43c-ce25-45ce-8c9c-098bc3a1f935 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:56:02.405450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2bda4-4a1b-4f94-9fb7-ac274f908be8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:56:02.406063 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2bda4-4a1b-4f94-9fb7-ac274f908be8 service nova] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:02.406344 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2bda4-4a1b-4f94-9fb7-ac274f908be8 service nova] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:02.406621 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2bda4-4a1b-4f94-9fb7-ac274f908be8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:02.415875 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2bda4-4a1b-4f94-9fb7-ac274f908be8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:56:02.417748 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2bda4-4a1b-4f94-9fb7-ac274f908be8 service nova] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:56:02.428391 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 503/984] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:56:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:56:04.949644 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50868fef-6bea-48c3-a1f0-faf991b5bc41 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:04.950163 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50868fef-6bea-48c3-a1f0-faf991b5bc41 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:04.950368 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50868fef-6bea-48c3-a1f0-faf991b5bc41 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:04.951524 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 482/985] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:56:04.956676 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fca962-b2ff-442f-83f1-4451434c5954 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:04.957102 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fca962-b2ff-442f-83f1-4451434c5954 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:04.957237 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fca962-b2ff-442f-83f1-4451434c5954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:04.977239 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-41fca962-b2ff-442f-83f1-4451434c5954 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:04.978433 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-41fca962-b2ff-442f-83f1-4451434c5954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:04.986232 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 504/986] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:56:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:56:05.338127 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ca9c1-ebe3-4dd8-955c-fcf4a493c0d1 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:05.338409 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ca9c1-ebe3-4dd8-955c-fcf4a493c0d1 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:05.338971 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ca9c1-ebe3-4dd8-955c-fcf4a493c0d1 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:05.340764 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 483/987] 10.222.0.43 () {54 vars in 962 bytes} [Fri Aug 19 03:56:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:56:05.347435 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4e198-6b7f-4f81-8bfd-0f60e15eb623 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:05.347722 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4e198-6b7f-4f81-8bfd-0f60e15eb623 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:05.348260 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4e198-6b7f-4f81-8bfd-0f60e15eb623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:05.369954 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-81c4e198-6b7f-4f81-8bfd-0f60e15eb623 None None] MFA Rules not processed for user `7aab3a88f9d0401db32fbaadef2711ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:05.371156 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-81c4e198-6b7f-4f81-8bfd-0f60e15eb623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:05.380265 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 505/988] 10.222.0.43 () {58 vars in 1059 bytes} [Fri Aug 19 03:56:05 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:56:05.387877 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ca9c1-ebe3-4dd8-955c-fcf4a493c0d1 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:56:05.405830 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ca9c1-ebe3-4dd8-955c-fcf4a493c0d1 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:56:05.413002 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c6fc3-aa7b-4e45-8d70-9007d566218a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:56:05.414141 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c6fc3-aa7b-4e45-8d70-9007d566218a service nova] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:05.414983 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c6fc3-aa7b-4e45-8d70-9007d566218a service nova] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:05.414983 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c6fc3-aa7b-4e45-8d70-9007d566218a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:05.423962 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c6fc3-aa7b-4e45-8d70-9007d566218a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:56:05.425603 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c6fc3-aa7b-4e45-8d70-9007d566218a service nova] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:56:05.440681 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 484/989] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:56:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:56:07.774301 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0808cc3-a60f-4e5b-92a5-e981b8e81ff3 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:07.775405 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0808cc3-a60f-4e5b-92a5-e981b8e81ff3 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:07.775891 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0808cc3-a60f-4e5b-92a5-e981b8e81ff3 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:07.777569 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 506/990] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:56:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:56:07.783592 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429acc46-b39d-49fb-b8cc-c74261ad80bd None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:07.784643 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429acc46-b39d-49fb-b8cc-c74261ad80bd None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:07.785176 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429acc46-b39d-49fb-b8cc-c74261ad80bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:07.807175 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-429acc46-b39d-49fb-b8cc-c74261ad80bd None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:07.808813 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-429acc46-b39d-49fb-b8cc-c74261ad80bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:07.825516 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 485/991] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:56:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:56:08.181618 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0808cc3-a60f-4e5b-92a5-e981b8e81ff3 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:56:08.197369 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0808cc3-a60f-4e5b-92a5-e981b8e81ff3 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:56:08.202718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c007c9-fa7a-4551-8dd1-ce625f3ae939 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:56:08.203579 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c007c9-fa7a-4551-8dd1-ce625f3ae939 service nova] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:08.204061 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c007c9-fa7a-4551-8dd1-ce625f3ae939 service nova] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:08.204661 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c007c9-fa7a-4551-8dd1-ce625f3ae939 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:08.214315 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c007c9-fa7a-4551-8dd1-ce625f3ae939 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:56:08.216322 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c007c9-fa7a-4551-8dd1-ce625f3ae939 service nova] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:56:08.238845 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 507/992] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:56:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:56:09.309229 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1760faf-d335-4270-bd65-8da99a407028 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:09.309671 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1760faf-d335-4270-bd65-8da99a407028 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:09.310300 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1760faf-d335-4270-bd65-8da99a407028 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:09.312153 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 486/993] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:56:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:56:09.317954 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d16059-a6f7-4a4e-9362-dd813780383a None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:09.318340 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d16059-a6f7-4a4e-9362-dd813780383a None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:09.318730 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d16059-a6f7-4a4e-9362-dd813780383a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:09.343691 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-f9d16059-a6f7-4a4e-9362-dd813780383a None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:09.345433 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-f9d16059-a6f7-4a4e-9362-dd813780383a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:09.365013 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 508/994] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:56:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 03:56:10.002957 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131cf91-3d78-4df8-b292-8ac011413bf0 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:10.002957 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131cf91-3d78-4df8-b292-8ac011413bf0 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:10.002957 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131cf91-3d78-4df8-b292-8ac011413bf0 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:10.005187 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 487/995] 10.222.0.43 () {54 vars in 964 bytes} [Fri Aug 19 03:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:56:10.009844 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef07dba-9408-452f-ad4c-66a191a64152 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:10.010130 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef07dba-9408-452f-ad4c-66a191a64152 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:10.010405 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef07dba-9408-452f-ad4c-66a191a64152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:10.049496 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-4ef07dba-9408-452f-ad4c-66a191a64152 None None] MFA Rules not processed for user `6e8bf3b9cdd9431398a088815a44c8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:10.050741 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-4ef07dba-9408-452f-ad4c-66a191a64152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:10.113599 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 509/996] 10.222.0.43 () {58 vars in 1061 bytes} [Fri Aug 19 03:56:10 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:56:10.121460 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131cf91-3d78-4df8-b292-8ac011413bf0 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:56:10.132420 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131cf91-3d78-4df8-b292-8ac011413bf0 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:56:10.136613 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66b176-1482-483e-9e2e-599e45dab403 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e8bf3b9cdd9431398a088815a44c8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:56:10.137219 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66b176-1482-483e-9e2e-599e45dab403 service cinder] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:10.137499 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66b176-1482-483e-9e2e-599e45dab403 service cinder] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:10.137774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66b176-1482-483e-9e2e-599e45dab403 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:10.147364 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66b176-1482-483e-9e2e-599e45dab403 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:56:10.148851 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66b176-1482-483e-9e2e-599e45dab403 service cinder] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:56:10.160297 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 488/997] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:56:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:56:10.587112 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2132f-110a-44ad-b20a-e94f7dfda213 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:10.587709 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2132f-110a-44ad-b20a-e94f7dfda213 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:10.587709 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2132f-110a-44ad-b20a-e94f7dfda213 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:10.590980 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 510/998] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:56:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:56:10.594694 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0c961-cefa-4d12-8c0d-089307763d9a None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:10.595546 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0c961-cefa-4d12-8c0d-089307763d9a None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:10.595846 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0c961-cefa-4d12-8c0d-089307763d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:10.616542 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-19d0c961-cefa-4d12-8c0d-089307763d9a None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:10.617665 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-19d0c961-cefa-4d12-8c0d-089307763d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:10.626069 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 489/999] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:56:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:56:10.983978 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2132f-110a-44ad-b20a-e94f7dfda213 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:56:11.010221 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2132f-110a-44ad-b20a-e94f7dfda213 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:56:11.020029 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce172f7-50a1-4ec5-a5f0-f9a980ab9a62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:56:11.021074 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce172f7-50a1-4ec5-a5f0-f9a980ab9a62 service nova] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:11.021544 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce172f7-50a1-4ec5-a5f0-f9a980ab9a62 service nova] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:11.022112 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce172f7-50a1-4ec5-a5f0-f9a980ab9a62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:11.035672 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce172f7-50a1-4ec5-a5f0-f9a980ab9a62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:56:11.038424 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce172f7-50a1-4ec5-a5f0-f9a980ab9a62 service nova] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:56:11.044576 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:56:11.062669 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 511/1000] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:56:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:56:13.288868 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f813d8-4316-4d86-8218-dad5b95a632b None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:13.289383 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f813d8-4316-4d86-8218-dad5b95a632b None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:13.289476 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f813d8-4316-4d86-8218-dad5b95a632b None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:13.290767 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 490/1001] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:56:13.296704 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b7562-f077-42d7-abdf-b164a88394d8 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:13.297123 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b7562-f077-42d7-abdf-b164a88394d8 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:13.297265 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b7562-f077-42d7-abdf-b164a88394d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:13.316796 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-150b7562-f077-42d7-abdf-b164a88394d8 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:13.317999 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-150b7562-f077-42d7-abdf-b164a88394d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:13.325729 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 512/1002] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:56:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:56:13.677025 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f813d8-4316-4d86-8218-dad5b95a632b None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:56:13.690542 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f813d8-4316-4d86-8218-dad5b95a632b None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:56:13.695495 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2a9b7-10df-4d14-ac87-2924fb47b3d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:56:13.696083 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2a9b7-10df-4d14-ac87-2924fb47b3d6 service nova] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:13.696383 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2a9b7-10df-4d14-ac87-2924fb47b3d6 service nova] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:13.696684 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2a9b7-10df-4d14-ac87-2924fb47b3d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:13.705075 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2a9b7-10df-4d14-ac87-2924fb47b3d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:56:13.706654 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2a9b7-10df-4d14-ac87-2924fb47b3d6 service nova] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:56:13.716265 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 491/1003] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:56:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:56:15.953350 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b2ebb-2b87-4565-863d-f6952a7d5dec None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:15.953902 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b2ebb-2b87-4565-863d-f6952a7d5dec None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:15.953902 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b2ebb-2b87-4565-863d-f6952a7d5dec None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:15.955543 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 513/1004] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:56:15.966444 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531aef2c-72af-48b8-933d-6618e6bdb7e0 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:15.967051 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531aef2c-72af-48b8-933d-6618e6bdb7e0 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:15.967051 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531aef2c-72af-48b8-933d-6618e6bdb7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:15.989704 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-531aef2c-72af-48b8-933d-6618e6bdb7e0 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:15.990985 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-531aef2c-72af-48b8-933d-6618e6bdb7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:16.000760 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 492/1005] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:56:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:56:16.348379 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b2ebb-2b87-4565-863d-f6952a7d5dec None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:56:16.362916 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b2ebb-2b87-4565-863d-f6952a7d5dec None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:56:16.367863 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49a29d-0dcb-4f2b-938b-25b4e3715e71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:56:16.368638 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49a29d-0dcb-4f2b-938b-25b4e3715e71 service nova] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:16.368930 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49a29d-0dcb-4f2b-938b-25b4e3715e71 service nova] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:16.369195 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49a29d-0dcb-4f2b-938b-25b4e3715e71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:16.378161 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49a29d-0dcb-4f2b-938b-25b4e3715e71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:56:16.379752 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49a29d-0dcb-4f2b-938b-25b4e3715e71 service nova] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:56:16.390247 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 514/1006] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:56:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:56:18.599940 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab8530-313b-4a65-b151-8787343c9499 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:18.600541 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab8530-313b-4a65-b151-8787343c9499 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:18.600541 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab8530-313b-4a65-b151-8787343c9499 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:18.601871 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 493/1007] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 03:56:18.607425 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2164dc6-73a3-48fb-82ec-4f49cdc1e426 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:18.607855 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2164dc6-73a3-48fb-82ec-4f49cdc1e426 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:18.608003 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2164dc6-73a3-48fb-82ec-4f49cdc1e426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:18.632762 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-c2164dc6-73a3-48fb-82ec-4f49cdc1e426 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:18.634492 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-c2164dc6-73a3-48fb-82ec-4f49cdc1e426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:18.645200 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 515/1008] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:56:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:56:19.008029 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab8530-313b-4a65-b151-8787343c9499 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:56:19.022062 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab8530-313b-4a65-b151-8787343c9499 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:56:19.027094 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b2aef-e768-49f4-884c-53c77d6631a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:56:19.027682 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b2aef-e768-49f4-884c-53c77d6631a5 service nova] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:19.027965 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b2aef-e768-49f4-884c-53c77d6631a5 service nova] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:19.028240 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b2aef-e768-49f4-884c-53c77d6631a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:19.037395 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b2aef-e768-49f4-884c-53c77d6631a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:56:19.038988 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b2aef-e768-49f4-884c-53c77d6631a5 service nova] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:56:19.049573 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 494/1009] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:56:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:56:21.342922 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43483eed-e9c3-4af6-9e60-296d93bf7dda None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:21.342922 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43483eed-e9c3-4af6-9e60-296d93bf7dda None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:21.343804 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43483eed-e9c3-4af6-9e60-296d93bf7dda None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:21.344354 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 516/1010] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:56:21.349835 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d5794-da1a-45af-905d-694ec2b2c774 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:21.350369 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d5794-da1a-45af-905d-694ec2b2c774 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:21.350369 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d5794-da1a-45af-905d-694ec2b2c774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:21.369692 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-d64d5794-da1a-45af-905d-694ec2b2c774 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:21.370901 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-d64d5794-da1a-45af-905d-694ec2b2c774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:21.379484 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 495/1011] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:56:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:56:21.742216 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43483eed-e9c3-4af6-9e60-296d93bf7dda None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:56:21.759226 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43483eed-e9c3-4af6-9e60-296d93bf7dda None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:56:21.764797 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4942e-d563-4734-b903-b889ea096a51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:56:21.765482 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4942e-d563-4734-b903-b889ea096a51 service nova] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:21.765802 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4942e-d563-4734-b903-b889ea096a51 service nova] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:21.766122 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4942e-d563-4734-b903-b889ea096a51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:21.775854 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4942e-d563-4734-b903-b889ea096a51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:56:21.777507 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4942e-d563-4734-b903-b889ea096a51 service nova] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:56:21.787919 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 517/1012] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:56:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:56:24.745191 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978b693-b9e9-462c-8906-14b21634ca99 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:24.745825 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978b693-b9e9-462c-8906-14b21634ca99 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:24.745825 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978b693-b9e9-462c-8906-14b21634ca99 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:24.747073 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 496/1013] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:56:24.752564 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18687a-ab76-49d6-a4bd-a4194dcaff67 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:24.753008 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18687a-ab76-49d6-a4bd-a4194dcaff67 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:24.753111 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18687a-ab76-49d6-a4bd-a4194dcaff67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:24.772945 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-dd18687a-ab76-49d6-a4bd-a4194dcaff67 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:24.774148 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-dd18687a-ab76-49d6-a4bd-a4194dcaff67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:24.782856 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 518/1014] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:56:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:56:25.127913 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978b693-b9e9-462c-8906-14b21634ca99 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:56:25.135413 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=46 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:56:25.142899 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978b693-b9e9-462c-8906-14b21634ca99 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:56:25.148126 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b675d8-8a47-4eea-978a-96e20b7a7967 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:56:25.150735 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b675d8-8a47-4eea-978a-96e20b7a7967 service nova] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:25.151017 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b675d8-8a47-4eea-978a-96e20b7a7967 service nova] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:25.151297 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b675d8-8a47-4eea-978a-96e20b7a7967 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:25.159857 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b675d8-8a47-4eea-978a-96e20b7a7967 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:56:25.161490 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b675d8-8a47-4eea-978a-96e20b7a7967 service nova] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:56:25.171353 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 497/1015] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:56:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:56:26.072985 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5cc33-e736-4e11-b5de-ca940d78fb42 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:26.073586 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5cc33-e736-4e11-b5de-ca940d78fb42 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:26.073586 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5cc33-e736-4e11-b5de-ca940d78fb42 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:26.074842 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 519/1016] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:56:26.080091 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9165b2-c923-44e5-b9c3-b33dcdfab592 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:26.080588 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9165b2-c923-44e5-b9c3-b33dcdfab592 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:26.080698 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9165b2-c923-44e5-b9c3-b33dcdfab592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:26.099865 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-9a9165b2-c923-44e5-b9c3-b33dcdfab592 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:26.101087 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-9a9165b2-c923-44e5-b9c3-b33dcdfab592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:26.109095 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 498/1017] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:56:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:56:26.467245 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87d8d7-4d4e-48b8-87eb-ce160d0ca7ef None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:26.467537 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87d8d7-4d4e-48b8-87eb-ce160d0ca7ef None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:26.467813 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87d8d7-4d4e-48b8-87eb-ce160d0ca7ef None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:26.469151 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 520/1018] 10.222.0.43 () {54 vars in 967 bytes} [Fri Aug 19 03:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:56:26.474307 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31da918-d37b-49b4-9ba6-187585d68858 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:26.474600 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31da918-d37b-49b4-9ba6-187585d68858 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:26.474883 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31da918-d37b-49b4-9ba6-187585d68858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:26.512770 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-b31da918-d37b-49b4-9ba6-187585d68858 None None] MFA Rules not processed for user `cfee7b193add48478b5240198b1aa602`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:26.513973 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-b31da918-d37b-49b4-9ba6-187585d68858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:26.573539 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 499/1019] 10.222.0.43 () {58 vars in 1064 bytes} [Fri Aug 19 03:56:26 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:56:26.580916 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87d8d7-4d4e-48b8-87eb-ce160d0ca7ef None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:56:26.591084 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87d8d7-4d4e-48b8-87eb-ce160d0ca7ef None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:56:26.594504 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded92d2-4a26-43fa-9cc3-1b34633cc70b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfee7b193add48478b5240198b1aa602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:56:26.595588 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded92d2-4a26-43fa-9cc3-1b34633cc70b service glance] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:26.595863 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded92d2-4a26-43fa-9cc3-1b34633cc70b service glance] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:26.596131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded92d2-4a26-43fa-9cc3-1b34633cc70b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:26.604713 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded92d2-4a26-43fa-9cc3-1b34633cc70b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:56:26.606119 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded92d2-4a26-43fa-9cc3-1b34633cc70b service glance] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:56:26.615799 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 521/1020] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:56:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:56:27.363071 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfc73a-8b74-4513-ae21-673263d1cdb0 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:27.363717 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfc73a-8b74-4513-ae21-673263d1cdb0 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:27.363717 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfc73a-8b74-4513-ae21-673263d1cdb0 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:27.365018 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 500/1021] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:56:27.370311 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c70430-273c-42d0-9f26-190b4464527a None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:27.370746 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c70430-273c-42d0-9f26-190b4464527a None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:27.370929 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c70430-273c-42d0-9f26-190b4464527a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:27.390451 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-68c70430-273c-42d0-9f26-190b4464527a None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:27.391700 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-68c70430-273c-42d0-9f26-190b4464527a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:27.400160 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 522/1022] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:56:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:56:27.756838 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dfc73a-8b74-4513-ae21-673263d1cdb0 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:56:27.770488 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dfc73a-8b74-4513-ae21-673263d1cdb0 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:56:27.775417 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b7058-3e90-4b98-8780-9fbe7faad13d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:56:27.776023 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b7058-3e90-4b98-8780-9fbe7faad13d service nova] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:27.776304 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b7058-3e90-4b98-8780-9fbe7faad13d service nova] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:27.776618 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b7058-3e90-4b98-8780-9fbe7faad13d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:27.785263 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b7058-3e90-4b98-8780-9fbe7faad13d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:56:27.786875 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b7058-3e90-4b98-8780-9fbe7faad13d service nova] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:56:27.796752 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 501/1023] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:56:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:56:30.051295 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74580208-8176-4d0d-9e31-a5d617cf60ca None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:30.051974 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74580208-8176-4d0d-9e31-a5d617cf60ca None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:30.051974 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74580208-8176-4d0d-9e31-a5d617cf60ca None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:30.053223 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 523/1024] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:56:30.065362 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fee638-0ebd-4c29-ba2c-0a115a5b1d9f None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:30.065916 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fee638-0ebd-4c29-ba2c-0a115a5b1d9f None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:30.066083 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fee638-0ebd-4c29-ba2c-0a115a5b1d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:30.087755 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-b0fee638-0ebd-4c29-ba2c-0a115a5b1d9f None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:30.087755 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-b0fee638-0ebd-4c29-ba2c-0a115a5b1d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:30.095327 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 502/1025] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:56:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 03:56:30.439560 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74580208-8176-4d0d-9e31-a5d617cf60ca None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:56:30.453678 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74580208-8176-4d0d-9e31-a5d617cf60ca None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:56:30.459240 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b44a96-65e8-4685-bf03-07214f0d1acc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:56:30.459841 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b44a96-65e8-4685-bf03-07214f0d1acc service nova] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:30.460118 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b44a96-65e8-4685-bf03-07214f0d1acc service nova] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:30.460389 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b44a96-65e8-4685-bf03-07214f0d1acc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:30.469266 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b44a96-65e8-4685-bf03-07214f0d1acc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:56:30.470867 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b44a96-65e8-4685-bf03-07214f0d1acc service nova] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:56:30.480696 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 524/1026] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:56:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:56:40.080575 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=50 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:56:40.476325 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=37 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:56:41.708796 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ecf0e-bbc1-4ebd-82a9-d7eb7ebafe4b None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:41.709473 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ecf0e-bbc1-4ebd-82a9-d7eb7ebafe4b None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:41.709473 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ecf0e-bbc1-4ebd-82a9-d7eb7ebafe4b None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:41.711307 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 503/1027] 10.222.0.43 () {54 vars in 918 bytes} [Fri Aug 19 03:56:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:56:41.716601 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76b55a-35a4-4dd7-8da4-6b076b776ac4 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:41.717058 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76b55a-35a4-4dd7-8da4-6b076b776ac4 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:41.717187 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76b55a-35a4-4dd7-8da4-6b076b776ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:41.735983 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-2d76b55a-35a4-4dd7-8da4-6b076b776ac4 None None] MFA Rules not processed for user `366baacae7c143929a64f5b639c17a99`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:41.737241 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-2d76b55a-35a4-4dd7-8da4-6b076b776ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:41.745699 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 525/1028] 10.222.0.43 () {58 vars in 1015 bytes} [Fri Aug 19 03:56:41 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:56:41.760019 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fd390-a2f2-405e-8b9b-185a21da40cc None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:41.760301 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fd390-a2f2-405e-8b9b-185a21da40cc None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:41.760605 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fd390-a2f2-405e-8b9b-185a21da40cc None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:41.761918 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 504/1029] 10.222.0.43 () {54 vars in 918 bytes} [Fri Aug 19 03:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:56:41.766491 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c7b6e-2ce9-4c1d-9182-e03981b4ad59 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:41.766778 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c7b6e-2ce9-4c1d-9182-e03981b4ad59 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:41.767053 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c7b6e-2ce9-4c1d-9182-e03981b4ad59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:41.786341 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-b75c7b6e-2ce9-4c1d-9182-e03981b4ad59 None None] MFA Rules not processed for user `7aab3a88f9d0401db32fbaadef2711ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:41.787537 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-b75c7b6e-2ce9-4c1d-9182-e03981b4ad59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:41.795976 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 526/1030] 10.222.0.43 () {58 vars in 1015 bytes} [Fri Aug 19 03:56:41 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 03:56:44.462162 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd4af4-e376-4be0-ba01-16ed0bdb3353 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:44.462738 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd4af4-e376-4be0-ba01-16ed0bdb3353 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:44.462738 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd4af4-e376-4be0-ba01-16ed0bdb3353 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:44.463955 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 505/1031] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 03:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:56:44.469275 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d62a0-5573-4139-a95c-61f499a88ffe None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:44.469749 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d62a0-5573-4139-a95c-61f499a88ffe None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:44.469854 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d62a0-5573-4139-a95c-61f499a88ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:44.488806 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-c22d62a0-5573-4139-a95c-61f499a88ffe None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:44.489982 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-c22d62a0-5573-4139-a95c-61f499a88ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:44.497552 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 527/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 03:56:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:56:44.848037 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd4af4-e376-4be0-ba01-16ed0bdb3353 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:56:44.861241 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd4af4-e376-4be0-ba01-16ed0bdb3353 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:56:44.866109 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb23df-0525-4122-9c1f-63e25883b3bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:56:44.866696 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb23df-0525-4122-9c1f-63e25883b3bc service nova] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:44.866972 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb23df-0525-4122-9c1f-63e25883b3bc service nova] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:44.867242 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb23df-0525-4122-9c1f-63e25883b3bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:44.875164 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb23df-0525-4122-9c1f-63e25883b3bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:56:44.876774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb23df-0525-4122-9c1f-63e25883b3bc service nova] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:56:44.886394 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 506/1033] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:56:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:56:45.831640 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bded8-98f7-4127-8eb1-5b1ac35a4abf None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:45.832170 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bded8-98f7-4127-8eb1-5b1ac35a4abf None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:45.832170 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bded8-98f7-4127-8eb1-5b1ac35a4abf None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:45.833521 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 528/1034] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 03:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:56:45.838425 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d771d7-55ed-4075-af81-4cad46a695e9 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:45.838845 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d771d7-55ed-4075-af81-4cad46a695e9 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:45.838953 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d771d7-55ed-4075-af81-4cad46a695e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:45.857808 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-b0d771d7-55ed-4075-af81-4cad46a695e9 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:45.858995 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-b0d771d7-55ed-4075-af81-4cad46a695e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:45.866694 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 507/1035] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 03:56:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:56:46.084460 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bded8-98f7-4127-8eb1-5b1ac35a4abf None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:56:46.097597 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bded8-98f7-4127-8eb1-5b1ac35a4abf None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:56:46.102986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21acc0ed-ab32-44d6-9030-e8da426b9a38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:56:46.103572 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acc0ed-ab32-44d6-9030-e8da426b9a38 service nova] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:46.103849 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acc0ed-ab32-44d6-9030-e8da426b9a38 service nova] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:46.104119 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acc0ed-ab32-44d6-9030-e8da426b9a38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:46.111960 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21acc0ed-ab32-44d6-9030-e8da426b9a38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:56:46.113571 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21acc0ed-ab32-44d6-9030-e8da426b9a38 service nova] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:56:46.123468 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 529/1036] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:56:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:56:47.006770 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001ea6c-2ef1-4971-bbef-54d983ab9d89 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:47.007362 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001ea6c-2ef1-4971-bbef-54d983ab9d89 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:47.007362 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001ea6c-2ef1-4971-bbef-54d983ab9d89 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:47.009239 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 508/1037] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 03:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:56:47.014070 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfb168-6d97-4126-ad85-1c506b6f11f3 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:47.014521 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfb168-6d97-4126-ad85-1c506b6f11f3 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:47.014618 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfb168-6d97-4126-ad85-1c506b6f11f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:47.035044 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-dcbfb168-6d97-4126-ad85-1c506b6f11f3 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:47.036242 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-dcbfb168-6d97-4126-ad85-1c506b6f11f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:47.043953 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 530/1038] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 03:56:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:56:47.207018 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001ea6c-2ef1-4971-bbef-54d983ab9d89 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:56:47.220376 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001ea6c-2ef1-4971-bbef-54d983ab9d89 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:56:47.225344 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca3f20-2e64-4185-bf96-774372a6dd2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:56:47.225943 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca3f20-2e64-4185-bf96-774372a6dd2b service nova] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:47.226207 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca3f20-2e64-4185-bf96-774372a6dd2b service nova] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:47.226475 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca3f20-2e64-4185-bf96-774372a6dd2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:47.234296 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca3f20-2e64-4185-bf96-774372a6dd2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:56:47.235857 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca3f20-2e64-4185-bf96-774372a6dd2b service nova] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:56:47.245572 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 509/1039] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:56:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:56:48.119682 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe2654-2062-433f-a629-0263009c8e7b None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:48.120272 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe2654-2062-433f-a629-0263009c8e7b None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:48.120272 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe2654-2062-433f-a629-0263009c8e7b None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:48.121564 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 531/1040] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 03:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:56:48.126524 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94260936-25d6-4b0a-8381-2272ee3add2c None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:48.126957 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94260936-25d6-4b0a-8381-2272ee3add2c None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:48.127064 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94260936-25d6-4b0a-8381-2272ee3add2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:48.146009 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-94260936-25d6-4b0a-8381-2272ee3add2c None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:48.147185 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-94260936-25d6-4b0a-8381-2272ee3add2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:48.155431 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 510/1041] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 03:56:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:56:48.306958 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe2654-2062-433f-a629-0263009c8e7b None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:56:48.320408 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe2654-2062-433f-a629-0263009c8e7b None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:56:48.325824 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a996d-c66b-403e-87dc-1179961a00eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:56:48.326412 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a996d-c66b-403e-87dc-1179961a00eb service nova] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:48.326691 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a996d-c66b-403e-87dc-1179961a00eb service nova] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:48.326963 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a996d-c66b-403e-87dc-1179961a00eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:48.334833 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a996d-c66b-403e-87dc-1179961a00eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:56:48.336399 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a996d-c66b-403e-87dc-1179961a00eb service nova] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:56:48.346243 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 532/1042] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:56:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:56:49.203354 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cfd22-f6f4-4996-b455-66ca8786a6da None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:49.203839 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cfd22-f6f4-4996-b455-66ca8786a6da None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:49.203954 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cfd22-f6f4-4996-b455-66ca8786a6da None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:49.205317 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 511/1043] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 03:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:56:49.210283 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d264c5-8f5c-4a72-8a41-aab5f4bef66b None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:49.210740 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d264c5-8f5c-4a72-8a41-aab5f4bef66b None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:49.210847 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d264c5-8f5c-4a72-8a41-aab5f4bef66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:49.230256 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-e0d264c5-8f5c-4a72-8a41-aab5f4bef66b None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:49.231449 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-e0d264c5-8f5c-4a72-8a41-aab5f4bef66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:49.239252 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 533/1044] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 03:56:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:56:49.392340 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04cfd22-f6f4-4996-b455-66ca8786a6da None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:56:49.406189 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04cfd22-f6f4-4996-b455-66ca8786a6da None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:56:49.411108 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b657d-9a1b-49a0-b1d5-a4726872e6f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:56:49.411693 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b657d-9a1b-49a0-b1d5-a4726872e6f6 service nova] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:49.411972 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b657d-9a1b-49a0-b1d5-a4726872e6f6 service nova] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:49.412246 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b657d-9a1b-49a0-b1d5-a4726872e6f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:49.420729 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b657d-9a1b-49a0-b1d5-a4726872e6f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:56:49.422303 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b657d-9a1b-49a0-b1d5-a4726872e6f6 service nova] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:56:49.431420 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 512/1045] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:56:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:56:50.229581 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe6865-2c5d-4489-b9be-c440ff58f47a None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:50.230059 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe6865-2c5d-4489-b9be-c440ff58f47a None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:50.230170 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe6865-2c5d-4489-b9be-c440ff58f47a None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:50.231479 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 534/1046] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 03:56:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:56:50.236199 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168f225-8b18-42f5-814c-ade4da827cdc None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:50.236625 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168f225-8b18-42f5-814c-ade4da827cdc None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:50.236774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168f225-8b18-42f5-814c-ade4da827cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:50.255577 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-2168f225-8b18-42f5-814c-ade4da827cdc None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:50.256784 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-2168f225-8b18-42f5-814c-ade4da827cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:50.264500 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 513/1047] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 03:56:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:56:50.418963 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe6865-2c5d-4489-b9be-c440ff58f47a None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:56:50.432346 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe6865-2c5d-4489-b9be-c440ff58f47a None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:56:50.437286 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b539b59-0777-471a-a643-5a6a79918f81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:56:50.437903 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b539b59-0777-471a-a643-5a6a79918f81 service nova] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:50.438183 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b539b59-0777-471a-a643-5a6a79918f81 service nova] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:50.438457 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b539b59-0777-471a-a643-5a6a79918f81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:50.446688 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b539b59-0777-471a-a643-5a6a79918f81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:56:50.448289 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b539b59-0777-471a-a643-5a6a79918f81 service nova] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:56:50.457533 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 535/1048] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:56:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:56:51.258834 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c39b00-f339-44ef-aa5e-638aaaa5f97e None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:51.259407 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c39b00-f339-44ef-aa5e-638aaaa5f97e None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:51.259525 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c39b00-f339-44ef-aa5e-638aaaa5f97e None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:51.261562 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 514/1049] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 03:56:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:56:51.266450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfdcf1-1208-4299-9993-0100d8f5eb5c None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:51.266849 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfdcf1-1208-4299-9993-0100d8f5eb5c None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:51.266995 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfdcf1-1208-4299-9993-0100d8f5eb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:51.285942 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-c2cfdcf1-1208-4299-9993-0100d8f5eb5c None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:51.287129 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-c2cfdcf1-1208-4299-9993-0100d8f5eb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:51.295433 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 536/1050] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 03:56:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:56:51.449721 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c39b00-f339-44ef-aa5e-638aaaa5f97e None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:56:51.463322 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c39b00-f339-44ef-aa5e-638aaaa5f97e None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:56:51.468238 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150a04e-78ee-4e73-8ab5-aca20861e7ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:56:51.468873 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150a04e-78ee-4e73-8ab5-aca20861e7ec service nova] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:51.469180 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150a04e-78ee-4e73-8ab5-aca20861e7ec service nova] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:51.469459 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150a04e-78ee-4e73-8ab5-aca20861e7ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:51.477406 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150a04e-78ee-4e73-8ab5-aca20861e7ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:56:51.478981 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150a04e-78ee-4e73-8ab5-aca20861e7ec service nova] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:56:51.488815 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 515/1051] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:56:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:56:52.288034 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ca677-4ad7-49d2-b536-63e6b41e15e7 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:52.288685 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ca677-4ad7-49d2-b536-63e6b41e15e7 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:52.288685 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ca677-4ad7-49d2-b536-63e6b41e15e7 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:52.289908 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 537/1052] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 03:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:56:52.294726 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdaa70-407d-4075-b3bb-fb528d7c1ab8 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:52.295101 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdaa70-407d-4075-b3bb-fb528d7c1ab8 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:52.295283 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdaa70-407d-4075-b3bb-fb528d7c1ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:52.314168 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-21cdaa70-407d-4075-b3bb-fb528d7c1ab8 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:52.315625 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-21cdaa70-407d-4075-b3bb-fb528d7c1ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:52.323860 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 516/1053] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 03:56:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:56:52.478551 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ca677-4ad7-49d2-b536-63e6b41e15e7 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:56:52.491578 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ca677-4ad7-49d2-b536-63e6b41e15e7 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:56:52.496988 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbc0f9-2683-4ad3-ac00-17d998c30a8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:56:52.497574 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbc0f9-2683-4ad3-ac00-17d998c30a8c service nova] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:52.497848 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbc0f9-2683-4ad3-ac00-17d998c30a8c service nova] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:52.498115 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbc0f9-2683-4ad3-ac00-17d998c30a8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:52.506154 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbc0f9-2683-4ad3-ac00-17d998c30a8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:56:52.507747 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbc0f9-2683-4ad3-ac00-17d998c30a8c service nova] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:56:52.517747 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 538/1054] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:56:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:56:53.320114 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c7175-37fb-41b6-b73f-221530ab8f7e None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:53.320700 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c7175-37fb-41b6-b73f-221530ab8f7e None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:53.320700 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c7175-37fb-41b6-b73f-221530ab8f7e None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:53.322029 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 517/1055] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 03:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:56:53.326935 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b081da-6ec7-4748-a06e-6ce2695b0930 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:53.327322 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b081da-6ec7-4748-a06e-6ce2695b0930 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:53.327490 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b081da-6ec7-4748-a06e-6ce2695b0930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:53.347019 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-06b081da-6ec7-4748-a06e-6ce2695b0930 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:53.348248 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-06b081da-6ec7-4748-a06e-6ce2695b0930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:53.356669 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 539/1056] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 03:56:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:56:53.510208 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c7175-37fb-41b6-b73f-221530ab8f7e None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:56:53.523760 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c7175-37fb-41b6-b73f-221530ab8f7e None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:56:53.529311 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a54ca-0d06-4fe1-af4e-96f6a2959208 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:56:53.529898 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a54ca-0d06-4fe1-af4e-96f6a2959208 service nova] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:53.530173 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a54ca-0d06-4fe1-af4e-96f6a2959208 service nova] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:53.530446 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a54ca-0d06-4fe1-af4e-96f6a2959208 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:53.538221 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a54ca-0d06-4fe1-af4e-96f6a2959208 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:56:53.539799 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a54ca-0d06-4fe1-af4e-96f6a2959208 service nova] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:56:53.548803 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 518/1057] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:56:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:56:55.603342 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192c2ef-c132-480d-966e-050f31273b5e None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:55.603790 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192c2ef-c132-480d-966e-050f31273b5e None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:55.603881 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192c2ef-c132-480d-966e-050f31273b5e None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:55.605247 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 540/1058] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 03:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:56:55.610330 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509e203-3705-443b-aecf-a7db70fb2eba None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:55.610708 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509e203-3705-443b-aecf-a7db70fb2eba None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:55.610909 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509e203-3705-443b-aecf-a7db70fb2eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:55.630053 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-7509e203-3705-443b-aecf-a7db70fb2eba None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:55.631255 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-7509e203-3705-443b-aecf-a7db70fb2eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:55.639596 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 519/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 03:56:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:56:55.977892 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192c2ef-c132-480d-966e-050f31273b5e None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:56:55.988905 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192c2ef-c132-480d-966e-050f31273b5e None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:56:55.992326 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8a537-5d63-41f2-9de0-c3e07b7b411d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:56:55.992941 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8a537-5d63-41f2-9de0-c3e07b7b411d service neutron] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:55.993213 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8a537-5d63-41f2-9de0-c3e07b7b411d service neutron] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:55.993479 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8a537-5d63-41f2-9de0-c3e07b7b411d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:56.002712 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8a537-5d63-41f2-9de0-c3e07b7b411d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:56:56.004144 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8a537-5d63-41f2-9de0-c3e07b7b411d service neutron] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:56:56.013480 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 541/1060] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:56:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:56:58.315656 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac43386-5a8f-4db5-aecb-1adb9dc3dcba None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:58.316240 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac43386-5a8f-4db5-aecb-1adb9dc3dcba None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:58.316240 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac43386-5a8f-4db5-aecb-1adb9dc3dcba None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:58.317854 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 520/1061] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 03:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:56:58.322989 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8616d-9923-4b0a-9d9d-8445f47ba08d None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:58.323384 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8616d-9923-4b0a-9d9d-8445f47ba08d None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:58.323532 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8616d-9923-4b0a-9d9d-8445f47ba08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:58.342159 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-23a8616d-9923-4b0a-9d9d-8445f47ba08d None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:56:58.343346 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-23a8616d-9923-4b0a-9d9d-8445f47ba08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:56:58.351027 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 542/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 03:56:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:56:58.687997 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac43386-5a8f-4db5-aecb-1adb9dc3dcba None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:56:58.698846 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac43386-5a8f-4db5-aecb-1adb9dc3dcba None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:56:58.702350 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5a83d-e184-4e4d-8bf5-a28a4f190b68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:56:58.702938 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5a83d-e184-4e4d-8bf5-a28a4f190b68 service neutron] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:56:58.703212 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5a83d-e184-4e4d-8bf5-a28a4f190b68 service neutron] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:56:58.703484 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5a83d-e184-4e4d-8bf5-a28a4f190b68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:56:58.712024 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5a83d-e184-4e4d-8bf5-a28a4f190b68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:56:58.713473 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5a83d-e184-4e4d-8bf5-a28a4f190b68 service neutron] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:56:58.723205 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 521/1063] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:56:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:57:01.198703 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958103dd-5f28-40a4-84cf-275dde39c7ce None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:01.199170 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958103dd-5f28-40a4-84cf-275dde39c7ce None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:01.199266 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958103dd-5f28-40a4-84cf-275dde39c7ce None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:01.200607 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 543/1064] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 03:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:57:01.206365 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c451763-6dd7-4a0c-b30c-048805102c31 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:01.206765 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c451763-6dd7-4a0c-b30c-048805102c31 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:01.206923 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c451763-6dd7-4a0c-b30c-048805102c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:01.226082 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-2c451763-6dd7-4a0c-b30c-048805102c31 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:57:01.227267 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-2c451763-6dd7-4a0c-b30c-048805102c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:57:01.234915 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 522/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 03:57:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:57:01.579148 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958103dd-5f28-40a4-84cf-275dde39c7ce None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:57:01.590825 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958103dd-5f28-40a4-84cf-275dde39c7ce None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:57:01.594259 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd51b4c-3552-407a-826c-8f17f5b4c393 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:57:01.594848 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd51b4c-3552-407a-826c-8f17f5b4c393 service neutron] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:01.595122 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd51b4c-3552-407a-826c-8f17f5b4c393 service neutron] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:01.595391 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd51b4c-3552-407a-826c-8f17f5b4c393 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:01.603963 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd51b4c-3552-407a-826c-8f17f5b4c393 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:57:01.605415 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd51b4c-3552-407a-826c-8f17f5b4c393 service neutron] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:57:01.614721 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 544/1066] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:57:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:57:03.891278 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfacc69-ca80-408e-8e77-1d72b63bf10d None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:03.891800 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfacc69-ca80-408e-8e77-1d72b63bf10d None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:03.891800 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfacc69-ca80-408e-8e77-1d72b63bf10d None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:03.893192 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 523/1067] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 03:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:57:03.898480 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a4b81-5abe-4306-a6c4-63ceb5b7cf82 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:03.898903 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a4b81-5abe-4306-a6c4-63ceb5b7cf82 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:03.899038 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a4b81-5abe-4306-a6c4-63ceb5b7cf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:03.918259 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-170a4b81-5abe-4306-a6c4-63ceb5b7cf82 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:57:03.919448 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-170a4b81-5abe-4306-a6c4-63ceb5b7cf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:57:03.927759 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 545/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 03:57:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:57:04.269947 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfacc69-ca80-408e-8e77-1d72b63bf10d None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:57:04.280342 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfacc69-ca80-408e-8e77-1d72b63bf10d None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:57:04.283755 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3236c2-5c7c-432a-b400-1e525a94de33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:57:04.284348 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3236c2-5c7c-432a-b400-1e525a94de33 service neutron] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:04.284662 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3236c2-5c7c-432a-b400-1e525a94de33 service neutron] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:04.284934 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3236c2-5c7c-432a-b400-1e525a94de33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:04.293971 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3236c2-5c7c-432a-b400-1e525a94de33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:57:04.296247 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3236c2-5c7c-432a-b400-1e525a94de33 service neutron] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:57:04.305857 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 524/1069] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:57:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:57:06.533219 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447cae6-4d8c-4ef2-a25b-3da388d7aa9f None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:06.533745 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447cae6-4d8c-4ef2-a25b-3da388d7aa9f None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:06.533745 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447cae6-4d8c-4ef2-a25b-3da388d7aa9f None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:06.535021 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 546/1070] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 03:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:57:06.540203 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb811a-90f4-464d-9fb0-1c5933422f77 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:06.540635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb811a-90f4-464d-9fb0-1c5933422f77 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:06.540811 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb811a-90f4-464d-9fb0-1c5933422f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:06.560044 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-00eb811a-90f4-464d-9fb0-1c5933422f77 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:57:06.561253 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-00eb811a-90f4-464d-9fb0-1c5933422f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:57:06.569765 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 525/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 03:57:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:57:06.909581 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447cae6-4d8c-4ef2-a25b-3da388d7aa9f None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:57:06.920216 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447cae6-4d8c-4ef2-a25b-3da388d7aa9f None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:57:06.924359 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99b1d3-466c-49ef-9986-fab5b3b6fd38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:57:06.924981 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99b1d3-466c-49ef-9986-fab5b3b6fd38 service neutron] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:06.925256 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99b1d3-466c-49ef-9986-fab5b3b6fd38 service neutron] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:06.925528 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99b1d3-466c-49ef-9986-fab5b3b6fd38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:06.934185 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99b1d3-466c-49ef-9986-fab5b3b6fd38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:57:06.935608 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99b1d3-466c-49ef-9986-fab5b3b6fd38 service neutron] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:57:06.944720 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 547/1072] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:57:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 03:57:09.158715 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f23d81-591a-4c4b-a35d-3c81417f7522 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:09.159250 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f23d81-591a-4c4b-a35d-3c81417f7522 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:09.159250 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f23d81-591a-4c4b-a35d-3c81417f7522 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:09.160632 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 526/1073] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 03:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:57:09.166096 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d83df-c2df-4376-a747-24897b4f0e12 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:09.166516 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d83df-c2df-4376-a747-24897b4f0e12 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:09.166650 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d83df-c2df-4376-a747-24897b4f0e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:09.185704 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-937d83df-c2df-4376-a747-24897b4f0e12 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:57:09.186907 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-937d83df-c2df-4376-a747-24897b4f0e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:57:09.195224 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 548/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 03:57:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:57:09.531434 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f23d81-591a-4c4b-a35d-3c81417f7522 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:57:09.542208 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f23d81-591a-4c4b-a35d-3c81417f7522 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:57:09.545736 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7aaac3-3ed1-41d8-8891-61a3c399cc30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:57:09.546321 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7aaac3-3ed1-41d8-8891-61a3c399cc30 service neutron] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:09.546597 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7aaac3-3ed1-41d8-8891-61a3c399cc30 service neutron] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:09.546869 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7aaac3-3ed1-41d8-8891-61a3c399cc30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:09.556003 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7aaac3-3ed1-41d8-8891-61a3c399cc30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:57:09.557454 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7aaac3-3ed1-41d8-8891-61a3c399cc30 service neutron] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:57:09.567356 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 527/1075] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:57:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:57:11.785032 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3acea4-0213-44de-a09b-ba3a6bb6c9a7 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:11.785590 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3acea4-0213-44de-a09b-ba3a6bb6c9a7 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:11.785590 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3acea4-0213-44de-a09b-ba3a6bb6c9a7 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:11.786939 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 549/1076] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 03:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:57:11.792035 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e448011-daba-4bd3-9df5-45b1020cea11 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:11.792457 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e448011-daba-4bd3-9df5-45b1020cea11 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:11.792618 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e448011-daba-4bd3-9df5-45b1020cea11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:11.799869 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=70 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:57:11.812602 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-9e448011-daba-4bd3-9df5-45b1020cea11 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:57:11.813744 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-9e448011-daba-4bd3-9df5-45b1020cea11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:57:11.821555 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 528/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 03:57:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:57:12.161220 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3acea4-0213-44de-a09b-ba3a6bb6c9a7 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:57:12.166701 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=73 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:57:12.173254 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3acea4-0213-44de-a09b-ba3a6bb6c9a7 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:57:12.176747 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf1354-9e21-43f1-9ed8-8b50495ac9c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:57:12.177345 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf1354-9e21-43f1-9ed8-8b50495ac9c2 service neutron] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:12.177620 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf1354-9e21-43f1-9ed8-8b50495ac9c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:12.177889 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf1354-9e21-43f1-9ed8-8b50495ac9c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:12.186759 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf1354-9e21-43f1-9ed8-8b50495ac9c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:57:12.188808 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf1354-9e21-43f1-9ed8-8b50495ac9c2 service neutron] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:57:12.198125 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 550/1078] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:57:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:57:14.480824 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdca62-eb64-4724-8d19-00dea7a0578d None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:14.481409 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdca62-eb64-4724-8d19-00dea7a0578d None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:14.481409 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdca62-eb64-4724-8d19-00dea7a0578d None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:14.482627 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 529/1079] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 03:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 03:57:14.488459 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee59940-fa47-4338-909e-b61a565166ac None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:14.488934 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee59940-fa47-4338-909e-b61a565166ac None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:14.489057 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee59940-fa47-4338-909e-b61a565166ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:14.507524 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-eee59940-fa47-4338-909e-b61a565166ac None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:57:14.508765 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-eee59940-fa47-4338-909e-b61a565166ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:57:14.516416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 551/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 03:57:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:57:14.852418 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdca62-eb64-4724-8d19-00dea7a0578d None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:57:14.862988 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdca62-eb64-4724-8d19-00dea7a0578d None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:57:14.866469 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9d849-eb63-4e34-89eb-831629da6a38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:57:14.867091 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9d849-eb63-4e34-89eb-831629da6a38 service neutron] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:14.867372 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9d849-eb63-4e34-89eb-831629da6a38 service neutron] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:14.867648 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9d849-eb63-4e34-89eb-831629da6a38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:14.876252 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9d849-eb63-4e34-89eb-831629da6a38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:57:14.877825 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9d849-eb63-4e34-89eb-831629da6a38 service neutron] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:57:14.887230 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 530/1081] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:57:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:57:17.036689 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54257f-c9b8-4f6c-b4ba-6925144724cc None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:17.037259 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54257f-c9b8-4f6c-b4ba-6925144724cc None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:17.037259 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54257f-c9b8-4f6c-b4ba-6925144724cc None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:17.038546 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 552/1082] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 03:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:57:17.043638 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738aba2-348a-48dd-8c4a-09972d098e0e None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:17.044060 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738aba2-348a-48dd-8c4a-09972d098e0e None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:17.044187 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738aba2-348a-48dd-8c4a-09972d098e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:17.063554 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-b738aba2-348a-48dd-8c4a-09972d098e0e None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:57:17.065318 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-b738aba2-348a-48dd-8c4a-09972d098e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:57:17.073665 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 531/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 03:57:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:57:17.414329 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54257f-c9b8-4f6c-b4ba-6925144724cc None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:57:17.425440 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54257f-c9b8-4f6c-b4ba-6925144724cc None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:57:17.428869 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d990d-0621-4ba8-8fee-2b1d7444ebe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:57:17.429450 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d990d-0621-4ba8-8fee-2b1d7444ebe7 service neutron] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:17.429726 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d990d-0621-4ba8-8fee-2b1d7444ebe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:17.429998 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d990d-0621-4ba8-8fee-2b1d7444ebe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:17.438488 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d990d-0621-4ba8-8fee-2b1d7444ebe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:57:17.439932 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d990d-0621-4ba8-8fee-2b1d7444ebe7 service neutron] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:57:17.449489 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 553/1084] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:57:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:57:19.616009 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc40b3-d622-4b6e-b957-f6ecc76ca836 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:19.616551 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc40b3-d622-4b6e-b957-f6ecc76ca836 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:19.616664 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc40b3-d622-4b6e-b957-f6ecc76ca836 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:19.617936 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 532/1085] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 03:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:57:19.623270 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010af84-1ed4-4b3f-a4ce-c3fa4563f456 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:19.623718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010af84-1ed4-4b3f-a4ce-c3fa4563f456 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:19.623856 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010af84-1ed4-4b3f-a4ce-c3fa4563f456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:19.644280 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-3010af84-1ed4-4b3f-a4ce-c3fa4563f456 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:57:19.645550 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-3010af84-1ed4-4b3f-a4ce-c3fa4563f456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:57:19.653300 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 554/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 03:57:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 03:57:19.992473 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc40b3-d622-4b6e-b957-f6ecc76ca836 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:57:20.003816 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc40b3-d622-4b6e-b957-f6ecc76ca836 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:57:20.007253 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1a220-0015-47b6-882e-57eb3290720b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:57:20.007840 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1a220-0015-47b6-882e-57eb3290720b service neutron] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:20.008116 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1a220-0015-47b6-882e-57eb3290720b service neutron] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:20.008385 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1a220-0015-47b6-882e-57eb3290720b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:20.016929 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1a220-0015-47b6-882e-57eb3290720b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:57:20.018346 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1a220-0015-47b6-882e-57eb3290720b service neutron] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:57:20.027390 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 533/1087] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:57:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:57:29.638491 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=17 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:57:30.023455 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=17 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:57:43.640432 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363a6d7-543d-4e6f-bbd4-1c50ffea60a4 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:43.640995 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363a6d7-543d-4e6f-bbd4-1c50ffea60a4 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:43.641106 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363a6d7-543d-4e6f-bbd4-1c50ffea60a4 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:43.642354 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 555/1088] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:57:43.647598 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281ea81-a97b-4c6e-ba5f-eb9a504db193 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:43.648021 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281ea81-a97b-4c6e-ba5f-eb9a504db193 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:43.648133 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281ea81-a97b-4c6e-ba5f-eb9a504db193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:43.668246 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-6281ea81-a97b-4c6e-ba5f-eb9a504db193 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:57:43.669481 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-6281ea81-a97b-4c6e-ba5f-eb9a504db193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:57:43.677363 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 534/1089] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:57:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:57:44.039758 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf831c9-efba-4c97-914a-e3e03b084f05 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:44.040045 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf831c9-efba-4c97-914a-e3e03b084f05 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:44.040329 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf831c9-efba-4c97-914a-e3e03b084f05 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:44.041692 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 556/1090] 10.222.0.43 () {54 vars in 967 bytes} [Fri Aug 19 03:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:57:44.046884 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c8b1f-0448-448a-b670-19adcfef8ca5 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:44.047167 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c8b1f-0448-448a-b670-19adcfef8ca5 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:44.047441 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c8b1f-0448-448a-b670-19adcfef8ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:44.066817 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-5a4c8b1f-0448-448a-b670-19adcfef8ca5 None None] MFA Rules not processed for user `cfee7b193add48478b5240198b1aa602`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:57:44.067994 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-5a4c8b1f-0448-448a-b670-19adcfef8ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:57:44.075010 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 535/1091] 10.222.0.43 () {58 vars in 1064 bytes} [Fri Aug 19 03:57:44 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:57:44.082360 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf831c9-efba-4c97-914a-e3e03b084f05 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:57:44.092798 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf831c9-efba-4c97-914a-e3e03b084f05 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:57:44.096262 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b828dd5-8c26-403e-84b1-ef85707cf5fe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfee7b193add48478b5240198b1aa602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:57:44.096880 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b828dd5-8c26-403e-84b1-ef85707cf5fe service glance] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:44.097164 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b828dd5-8c26-403e-84b1-ef85707cf5fe service glance] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:44.097438 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b828dd5-8c26-403e-84b1-ef85707cf5fe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:44.106364 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b828dd5-8c26-403e-84b1-ef85707cf5fe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:57:44.107823 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b828dd5-8c26-403e-84b1-ef85707cf5fe service glance] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:57:44.117129 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 557/1092] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:57:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:57:46.351713 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8324c76-6762-4486-b12b-d6e84f55f2cb None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:46.352266 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8324c76-6762-4486-b12b-d6e84f55f2cb None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:46.352388 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8324c76-6762-4486-b12b-d6e84f55f2cb None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:46.353672 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 536/1093] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:57:46.358839 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83e17c-6f9f-4baf-94be-97ac8257be96 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:46.359276 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83e17c-6f9f-4baf-94be-97ac8257be96 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:46.359384 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83e17c-6f9f-4baf-94be-97ac8257be96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:46.378650 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-4c83e17c-6f9f-4baf-94be-97ac8257be96 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:57:46.379856 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-4c83e17c-6f9f-4baf-94be-97ac8257be96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:57:46.388276 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 558/1094] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:57:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:57:46.715538 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8324c76-6762-4486-b12b-d6e84f55f2cb None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:57:46.728529 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8324c76-6762-4486-b12b-d6e84f55f2cb None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:57:46.732988 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206f97e-143e-4967-b755-73c1266bd552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:57:46.733581 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206f97e-143e-4967-b755-73c1266bd552 admin admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:46.733862 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206f97e-143e-4967-b755-73c1266bd552 admin admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:46.734136 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206f97e-143e-4967-b755-73c1266bd552 admin admin] PATH_INFO: `/v3/projects` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:46.734765 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206f97e-143e-4967-b755-73c1266bd552 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:57:46.736542 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: WARNING py.warnings [None req-9206f97e-143e-4967-b755-73c1266bd552 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 03:57:46.736542 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: warnings.warn(msg) Aug 19 03:57:46.736542 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: Aug 19 03:57:46.737697 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206f97e-143e-4967-b755-73c1266bd552 admin admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:57:46.755811 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 537/1095] 10.222.0.43 () {56 vars in 1108 bytes} [Fri Aug 19 03:57:46 2022] GET /identity/v3/projects => generated 1606 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 03:57:48.916345 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cdab1-e87d-4bd2-87b0-2d6fd3e2fc81 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:48.916958 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cdab1-e87d-4bd2-87b0-2d6fd3e2fc81 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:48.916958 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cdab1-e87d-4bd2-87b0-2d6fd3e2fc81 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:48.918234 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 559/1096] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:57:48.923400 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3521c-444b-450e-b1ec-613ffa9b8ea9 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:48.923794 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3521c-444b-450e-b1ec-613ffa9b8ea9 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:48.923954 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3521c-444b-450e-b1ec-613ffa9b8ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:48.942756 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-fbc3521c-444b-450e-b1ec-613ffa9b8ea9 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:57:48.943947 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-fbc3521c-444b-450e-b1ec-613ffa9b8ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:57:48.952187 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 538/1097] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:57:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:57:49.296565 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cdab1-e87d-4bd2-87b0-2d6fd3e2fc81 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:57:49.311011 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cdab1-e87d-4bd2-87b0-2d6fd3e2fc81 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:57:49.315848 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8acad07-5b1d-4cc9-9b6b-1f1377e4b831 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:57:49.316431 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acad07-5b1d-4cc9-9b6b-1f1377e4b831 service nova] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:49.316742 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acad07-5b1d-4cc9-9b6b-1f1377e4b831 service nova] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:49.317011 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acad07-5b1d-4cc9-9b6b-1f1377e4b831 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:49.325341 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8acad07-5b1d-4cc9-9b6b-1f1377e4b831 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:57:49.326903 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8acad07-5b1d-4cc9-9b6b-1f1377e4b831 service nova] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:57:49.336240 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 560/1098] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:57:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:57:51.663995 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f91879-08aa-41e0-8a73-d7efce024063 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:51.664550 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f91879-08aa-41e0-8a73-d7efce024063 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:51.664550 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f91879-08aa-41e0-8a73-d7efce024063 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:51.666426 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 539/1099] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:57:51.671435 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069427bd-8167-4c71-ba83-1985b82744f8 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:51.671859 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069427bd-8167-4c71-ba83-1985b82744f8 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:51.671965 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069427bd-8167-4c71-ba83-1985b82744f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:51.690931 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-069427bd-8167-4c71-ba83-1985b82744f8 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:57:51.692109 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-069427bd-8167-4c71-ba83-1985b82744f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:57:51.699749 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 561/1100] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:57:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:57:52.037982 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f91879-08aa-41e0-8a73-d7efce024063 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:57:52.049556 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f91879-08aa-41e0-8a73-d7efce024063 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:57:52.053102 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c038973-670d-4835-9e5e-069402cd33f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:57:52.053696 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c038973-670d-4835-9e5e-069402cd33f9 service neutron] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:52.053976 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c038973-670d-4835-9e5e-069402cd33f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:52.054252 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c038973-670d-4835-9e5e-069402cd33f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:52.062993 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c038973-670d-4835-9e5e-069402cd33f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:57:52.064428 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c038973-670d-4835-9e5e-069402cd33f9 service neutron] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:57:52.073652 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 540/1101] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:57:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:57:54.284381 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9fe58-a9dc-40da-946c-571d9f56ce03 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:54.284964 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9fe58-a9dc-40da-946c-571d9f56ce03 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:54.284964 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9fe58-a9dc-40da-946c-571d9f56ce03 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:54.286279 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 562/1102] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:57:54.291277 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171e5c2-c515-4246-82d9-ed1b65e644dc None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:54.291720 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171e5c2-c515-4246-82d9-ed1b65e644dc None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:54.291868 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171e5c2-c515-4246-82d9-ed1b65e644dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:54.311167 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-7171e5c2-c515-4246-82d9-ed1b65e644dc None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:57:54.312389 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-7171e5c2-c515-4246-82d9-ed1b65e644dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:57:54.320130 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 541/1103] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:57:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:57:54.664474 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9fe58-a9dc-40da-946c-571d9f56ce03 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:57:54.675520 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9fe58-a9dc-40da-946c-571d9f56ce03 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:57:54.678977 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90456b53-70f9-42f0-98de-7319d50d6f9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:57:54.679567 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90456b53-70f9-42f0-98de-7319d50d6f9a service neutron] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:54.679845 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90456b53-70f9-42f0-98de-7319d50d6f9a service neutron] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:54.680118 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90456b53-70f9-42f0-98de-7319d50d6f9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:54.689281 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90456b53-70f9-42f0-98de-7319d50d6f9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:57:54.690710 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90456b53-70f9-42f0-98de-7319d50d6f9a service neutron] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:57:54.699883 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 563/1104] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:57:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:57:56.944007 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e50bf-8de8-4612-b252-1b2190db5f0b None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:56.944566 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e50bf-8de8-4612-b252-1b2190db5f0b None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:56.944566 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e50bf-8de8-4612-b252-1b2190db5f0b None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:56.945950 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 542/1105] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:57:56.951144 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202b938-5501-4daf-b59c-c0833f64bbdc None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:56.951560 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202b938-5501-4daf-b59c-c0833f64bbdc None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:56.951703 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202b938-5501-4daf-b59c-c0833f64bbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:56.970609 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-c202b938-5501-4daf-b59c-c0833f64bbdc None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:57:56.971803 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-c202b938-5501-4daf-b59c-c0833f64bbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:57:56.980071 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 564/1106] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:57:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:57:57.328383 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e50bf-8de8-4612-b252-1b2190db5f0b None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:57:57.339243 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e50bf-8de8-4612-b252-1b2190db5f0b None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:57:57.342780 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bf065-770f-45ce-9a39-46a4620c8e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:57:57.343384 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bf065-770f-45ce-9a39-46a4620c8e35 service neutron] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:57.343659 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bf065-770f-45ce-9a39-46a4620c8e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:57.343927 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bf065-770f-45ce-9a39-46a4620c8e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:57.352810 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07bf065-770f-45ce-9a39-46a4620c8e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:57:57.354221 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07bf065-770f-45ce-9a39-46a4620c8e35 service neutron] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:57:57.363278 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 543/1107] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:57:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:57:59.701000 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5c1d3-d682-4d92-aaed-f264f0b400e3 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:59.701546 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5c1d3-d682-4d92-aaed-f264f0b400e3 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:59.701546 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5c1d3-d682-4d92-aaed-f264f0b400e3 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:59.702869 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 565/1108] 10.222.0.43 () {54 vars in 927 bytes} [Fri Aug 19 03:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:57:59.707978 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac36e04-0b5e-4a55-ae46-f8ffa46b9cf9 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:57:59.708383 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac36e04-0b5e-4a55-ae46-f8ffa46b9cf9 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:57:59.708818 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac36e04-0b5e-4a55-ae46-f8ffa46b9cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:57:59.727737 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-9ac36e04-0b5e-4a55-ae46-f8ffa46b9cf9 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:57:59.729007 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-9ac36e04-0b5e-4a55-ae46-f8ffa46b9cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:57:59.736780 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 544/1109] 10.222.0.43 () {58 vars in 1024 bytes} [Fri Aug 19 03:57:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:58:00.088621 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5c1d3-d682-4d92-aaed-f264f0b400e3 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:58:00.099289 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5c1d3-d682-4d92-aaed-f264f0b400e3 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:58:00.102816 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482234c-9251-42b5-bca2-7fc3b2174544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:58:00.103409 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482234c-9251-42b5-bca2-7fc3b2174544 service neutron] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:58:00.103687 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482234c-9251-42b5-bca2-7fc3b2174544 service neutron] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:58:00.103959 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482234c-9251-42b5-bca2-7fc3b2174544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:58:00.113439 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482234c-9251-42b5-bca2-7fc3b2174544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:58:00.114870 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482234c-9251-42b5-bca2-7fc3b2174544 service neutron] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:58:00.124733 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 566/1110] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:58:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:58:09.723072 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=33 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:58:10.120070 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=33 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:59:18.713716 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba982a-6138-4d3e-9b50-b1b34facf75b None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:59:18.714282 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba982a-6138-4d3e-9b50-b1b34facf75b None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:59:18.714282 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba982a-6138-4d3e-9b50-b1b34facf75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:59:18.737905 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-afba982a-6138-4d3e-9b50-b1b34facf75b None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:59:18.739168 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-afba982a-6138-4d3e-9b50-b1b34facf75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:59:18.747108 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 545/1111] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 03:59:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:59:18.755667 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb145676-d662-4e13-968f-342e7d7bbb4a None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:59:18.756170 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb145676-d662-4e13-968f-342e7d7bbb4a None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:59:18.756259 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb145676-d662-4e13-968f-342e7d7bbb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:59:18.776701 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-bb145676-d662-4e13-968f-342e7d7bbb4a None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:59:18.777908 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-bb145676-d662-4e13-968f-342e7d7bbb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:59:18.785755 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 567/1112] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 03:59:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:59:18.790539 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba982a-6138-4d3e-9b50-b1b34facf75b None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:59:18.800642 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba982a-6138-4d3e-9b50-b1b34facf75b None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:59:18.805201 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017d4ec-39ef-4949-a9ae-a002ba038268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:59:18.805799 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017d4ec-39ef-4949-a9ae-a002ba038268 admin admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:59:18.806080 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017d4ec-39ef-4949-a9ae-a002ba038268 admin admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:59:18.806358 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017d4ec-39ef-4949-a9ae-a002ba038268 admin admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:59:18.807006 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017d4ec-39ef-4949-a9ae-a002ba038268 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 03:59:18.807309 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017d4ec-39ef-4949-a9ae-a002ba038268 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:59:18.808316 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: WARNING py.warnings [None req-2017d4ec-39ef-4949-a9ae-a002ba038268 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 03:59:18.808316 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: warnings.warn(msg) Aug 19 03:59:18.808316 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: Aug 19 03:59:18.809250 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017d4ec-39ef-4949-a9ae-a002ba038268 admin admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:59:18.821102 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 546/1113] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 03:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 03:59:18.829044 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb145676-d662-4e13-968f-342e7d7bbb4a None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:59:18.838044 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb145676-d662-4e13-968f-342e7d7bbb4a None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:59:18.842602 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e15077-a65e-4d11-bad9-cc54ffef0474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:59:18.843185 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e15077-a65e-4d11-bad9-cc54ffef0474 admin admin] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:59:18.843464 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e15077-a65e-4d11-bad9-cc54ffef0474 admin admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:59:18.843738 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e15077-a65e-4d11-bad9-cc54ffef0474 admin admin] PATH_INFO: `/v3/projects` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:59:18.844683 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e15077-a65e-4d11-bad9-cc54ffef0474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:59:18.846395 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: WARNING py.warnings [None req-d7e15077-a65e-4d11-bad9-cc54ffef0474 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 03:59:18.846395 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: warnings.warn(msg) Aug 19 03:59:18.846395 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: Aug 19 03:59:18.847616 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e15077-a65e-4d11-bad9-cc54ffef0474 admin admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:59:18.873757 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 568/1114] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 03:59:18 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:59:18.878425 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017d4ec-39ef-4949-a9ae-a002ba038268 admin admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:59:18.888205 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017d4ec-39ef-4949-a9ae-a002ba038268 admin admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:59:18.942365 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94bbed-7503-4f80-8bef-15cc9623a714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:59:18.942890 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94bbed-7503-4f80-8bef-15cc9623a714 admin admin] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:59:18.943171 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94bbed-7503-4f80-8bef-15cc9623a714 admin admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:59:18.943448 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94bbed-7503-4f80-8bef-15cc9623a714 admin admin] PATH_INFO: `/v3/users` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:59:18.944067 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94bbed-7503-4f80-8bef-15cc9623a714 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:59:18.945099 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: WARNING py.warnings [None req-3d94bbed-7503-4f80-8bef-15cc9623a714 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 03:59:18.945099 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: warnings.warn(msg) Aug 19 03:59:18.945099 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: Aug 19 03:59:18.946314 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94bbed-7503-4f80-8bef-15cc9623a714 admin admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:59:18.967141 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 547/1115] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 03:59:18 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 03:59:18.971477 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e15077-a65e-4d11-bad9-cc54ffef0474 admin admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:59:18.981543 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e15077-a65e-4d11-bad9-cc54ffef0474 admin admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:59:18.986255 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384dbd0-19c2-4d2d-82dd-8dc227fc7d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:59:18.986851 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384dbd0-19c2-4d2d-82dd-8dc227fc7d4d admin admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:59:18.987641 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384dbd0-19c2-4d2d-82dd-8dc227fc7d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:59:18.987917 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384dbd0-19c2-4d2d-82dd-8dc227fc7d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:59:18.988621 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384dbd0-19c2-4d2d-82dd-8dc227fc7d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:59:18.989629 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: WARNING py.warnings [None req-2384dbd0-19c2-4d2d-82dd-8dc227fc7d4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 03:59:18.989629 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: warnings.warn(msg) Aug 19 03:59:18.989629 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: Aug 19 03:59:18.990513 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384dbd0-19c2-4d2d-82dd-8dc227fc7d4d admin admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:59:19.003406 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 569/1116] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 03:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 03:59:19.007592 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94bbed-7503-4f80-8bef-15cc9623a714 admin admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:59:19.017203 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94bbed-7503-4f80-8bef-15cc9623a714 admin admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:59:19.021647 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66ccf9-68df-4d95-88af-8ae6973b8d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:59:19.022223 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66ccf9-68df-4d95-88af-8ae6973b8d14 admin admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:59:19.022499 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66ccf9-68df-4d95-88af-8ae6973b8d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:59:19.022769 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66ccf9-68df-4d95-88af-8ae6973b8d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:59:19.023422 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66ccf9-68df-4d95-88af-8ae6973b8d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:59:19.024407 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: WARNING py.warnings [None req-2f66ccf9-68df-4d95-88af-8ae6973b8d14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 03:59:19.024407 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: warnings.warn(msg) Aug 19 03:59:19.024407 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: Aug 19 03:59:19.025326 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66ccf9-68df-4d95-88af-8ae6973b8d14 admin admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:59:19.038598 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 548/1117] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 03:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 03:59:19.042451 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384dbd0-19c2-4d2d-82dd-8dc227fc7d4d admin admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:59:19.052770 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384dbd0-19c2-4d2d-82dd-8dc227fc7d4d admin admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:59:19.057336 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ce328-5a58-47fe-ac79-3a55b206177f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:59:19.057970 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ce328-5a58-47fe-ac79-3a55b206177f admin admin] REQUEST_METHOD: `PUT` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:59:19.058253 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ce328-5a58-47fe-ac79-3a55b206177f admin admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:59:19.058528 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ce328-5a58-47fe-ac79-3a55b206177f admin admin] PATH_INFO: `/v3/projects/0cf3c18e3bef41efa6e6082be79785ac/users/934eec65f21245cb91b506e95104833b/roles/eaf433778e9e4d44bf6d1a1ea65d983f` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:59:19.072640 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ce328-5a58-47fe-ac79-3a55b206177f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cf3c18e3bef41efa6e6082be79785ac, user_id=934eec65f21245cb91b506e95104833b, role_id=eaf433778e9e4d44bf6d1a1ea65d983f)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:59:19.073672 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: WARNING py.warnings [None req-a99ce328-5a58-47fe-ac79-3a55b206177f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 03:59:19.073672 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: warnings.warn(msg) Aug 19 03:59:19.073672 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: Aug 19 03:59:19.075609 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ce328-5a58-47fe-ac79-3a55b206177f admin admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:59:19.088821 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 570/1118] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 03:59:19 2022] PUT /identity/v3/projects/0cf3c18e3bef41efa6e6082be79785ac/users/934eec65f21245cb91b506e95104833b/roles/eaf433778e9e4d44bf6d1a1ea65d983f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 03:59:19.101832 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c79ba9-c359-4a58-8c16-4f7dc350d181 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:59:19.102122 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c79ba9-c359-4a58-8c16-4f7dc350d181 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:59:19.102407 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c79ba9-c359-4a58-8c16-4f7dc350d181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:59:19.130523 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-40c79ba9-c359-4a58-8c16-4f7dc350d181 None None] MFA Rules not processed for user `934eec65f21245cb91b506e95104833b`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:59:19.131790 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-40c79ba9-c359-4a58-8c16-4f7dc350d181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:59:19.195199 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 549/1119] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 03:59:19 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:59:19.208303 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37e7bc-dd3c-4bd6-907d-3f1bb4b94a45 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:59:19.208640 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37e7bc-dd3c-4bd6-907d-3f1bb4b94a45 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:59:19.208924 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37e7bc-dd3c-4bd6-907d-3f1bb4b94a45 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:59:19.210252 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 571/1120] 10.222.0.43 () {54 vars in 964 bytes} [Fri Aug 19 03:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:59:19.215050 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5241e-57b0-4ad8-9de6-bbb323625d40 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:59:19.215339 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5241e-57b0-4ad8-9de6-bbb323625d40 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:59:19.215617 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5241e-57b0-4ad8-9de6-bbb323625d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:59:19.235219 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-dac5241e-57b0-4ad8-9de6-bbb323625d40 None None] MFA Rules not processed for user `6e8bf3b9cdd9431398a088815a44c8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:59:19.236416 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-dac5241e-57b0-4ad8-9de6-bbb323625d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:59:19.279522 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:59:19.288599 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 550/1121] 10.222.0.43 () {58 vars in 1061 bytes} [Fri Aug 19 03:59:19 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:59:19.296190 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37e7bc-dd3c-4bd6-907d-3f1bb4b94a45 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:59:19.307304 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37e7bc-dd3c-4bd6-907d-3f1bb4b94a45 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:59:19.310865 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68402928-2e62-4d4e-a6ed-bc107d99a2f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e8bf3b9cdd9431398a088815a44c8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:59:19.311451 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68402928-2e62-4d4e-a6ed-bc107d99a2f1 service cinder] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:59:19.311732 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68402928-2e62-4d4e-a6ed-bc107d99a2f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:59:19.312008 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68402928-2e62-4d4e-a6ed-bc107d99a2f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:59:19.319986 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68402928-2e62-4d4e-a6ed-bc107d99a2f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:59:19.321446 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68402928-2e62-4d4e-a6ed-bc107d99a2f1 service cinder] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:59:19.329971 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 572/1122] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:59:19 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:59:19.367854 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec634bc9-c264-4ea9-8220-270d4b4b5c80 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:59:19.368135 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec634bc9-c264-4ea9-8220-270d4b4b5c80 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:59:19.368407 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec634bc9-c264-4ea9-8220-270d4b4b5c80 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:59:19.369710 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 551/1123] 10.222.0.43 () {52 vars in 830 bytes} [Fri Aug 19 03:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 03:59:19.373248 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68402928-2e62-4d4e-a6ed-bc107d99a2f1 service cinder] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:59:19.433822 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68402928-2e62-4d4e-a6ed-bc107d99a2f1 service cinder] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:59:19.438693 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960179f-f5a0-4dfc-91b7-5de2503da9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:59:19.439303 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960179f-f5a0-4dfc-91b7-5de2503da9b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:59:19.439579 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960179f-f5a0-4dfc-91b7-5de2503da9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:59:19.439849 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960179f-f5a0-4dfc-91b7-5de2503da9b1 admin admin] PATH_INFO: `/v3/users/934eec65f21245cb91b506e95104833b` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:59:19.440981 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960179f-f5a0-4dfc-91b7-5de2503da9b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=934eec65f21245cb91b506e95104833b)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:59:19.441987 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: WARNING py.warnings [None req-1960179f-f5a0-4dfc-91b7-5de2503da9b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 03:59:19.441987 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: warnings.warn(msg) Aug 19 03:59:19.441987 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: Aug 19 03:59:19.443183 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960179f-f5a0-4dfc-91b7-5de2503da9b1 admin admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:59:19.507175 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [None req-1960179f-f5a0-4dfc-91b7-5de2503da9b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '934eec65f21245cb91b506e95104833b'} {{(pid=88197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 03:59:19.516393 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [None req-1960179f-f5a0-4dfc-91b7-5de2503da9b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '934eec65f21245cb91b506e95104833b'} {{(pid=88197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 03:59:19.539175 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [None req-1960179f-f5a0-4dfc-91b7-5de2503da9b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '934eec65f21245cb91b506e95104833b'} {{(pid=88197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 03:59:19.554430 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [None req-1960179f-f5a0-4dfc-91b7-5de2503da9b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '934eec65f21245cb91b506e95104833b'} {{(pid=88197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 03:59:19.555117 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [None req-1960179f-f5a0-4dfc-91b7-5de2503da9b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '934eec65f21245cb91b506e95104833b'} {{(pid=88197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 03:59:19.561035 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 573/1124] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 03:59:19 2022] DELETE /identity/v3/users/934eec65f21245cb91b506e95104833b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 03:59:19.565370 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37af648-a885-4231-9656-db7d9dd3d04e None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:59:19.565653 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37af648-a885-4231-9656-db7d9dd3d04e None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:59:19.565925 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37af648-a885-4231-9656-db7d9dd3d04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:59:19.584600 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-c37af648-a885-4231-9656-db7d9dd3d04e None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 03:59:19.585770 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-c37af648-a885-4231-9656-db7d9dd3d04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:59:19.642156 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 552/1125] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 03:59:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 03:59:19.652140 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960179f-f5a0-4dfc-91b7-5de2503da9b1 admin admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:59:19.653582 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-1960179f-f5a0-4dfc-91b7-5de2503da9b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:59:19.658853 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:59:19.711100 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960179f-f5a0-4dfc-91b7-5de2503da9b1 admin admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:59:19.714808 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1b943-7073-4f86-bce6-119c783769db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:59:19.715408 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1b943-7073-4f86-bce6-119c783769db service neutron] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:59:19.715686 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1b943-7073-4f86-bce6-119c783769db service neutron] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:59:19.715959 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1b943-7073-4f86-bce6-119c783769db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:59:19.725717 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1b943-7073-4f86-bce6-119c783769db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:59:19.727139 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1b943-7073-4f86-bce6-119c783769db service neutron] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:59:19.736243 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 574/1126] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 03:59:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 03:59:20.080760 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37af648-a885-4231-9656-db7d9dd3d04e None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 03:59:20.082789 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-c37af648-a885-4231-9656-db7d9dd3d04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 03:59:20.095131 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37af648-a885-4231-9656-db7d9dd3d04e None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 03:59:20.099883 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b837c-467d-4265-b269-9cf6abbf642e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 03:59:20.100539 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b837c-467d-4265-b269-9cf6abbf642e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 03:59:20.100824 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b837c-467d-4265-b269-9cf6abbf642e admin admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 03:59:20.101102 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b837c-467d-4265-b269-9cf6abbf642e admin admin] PATH_INFO: `/v3/projects/0cf3c18e3bef41efa6e6082be79785ac` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 03:59:20.102245 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b837c-467d-4265-b269-9cf6abbf642e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cf3c18e3bef41efa6e6082be79785ac)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 03:59:20.103208 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: WARNING py.warnings [None req-7f4b837c-467d-4265-b269-9cf6abbf642e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 03:59:20.103208 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: warnings.warn(msg) Aug 19 03:59:20.103208 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: Aug 19 03:59:20.106247 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b837c-467d-4265-b269-9cf6abbf642e admin admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 03:59:20.166923 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [None req-7f4b837c-467d-4265-b269-9cf6abbf642e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cf3c18e3bef41efa6e6082be79785ac', 'request_id': 'req-7f4b837c-467d-4265-b269-9cf6abbf642e'} {{(pid=88198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 03:59:20.181182 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [None req-7f4b837c-467d-4265-b269-9cf6abbf642e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cf3c18e3bef41efa6e6082be79785ac', 'request_id': 'req-7f4b837c-467d-4265-b269-9cf6abbf642e'} {{(pid=88198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 03:59:20.190150 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [None req-7f4b837c-467d-4265-b269-9cf6abbf642e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cf3c18e3bef41efa6e6082be79785ac', 'request_id': 'req-7f4b837c-467d-4265-b269-9cf6abbf642e'} {{(pid=88198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 03:59:20.201593 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [None req-7f4b837c-467d-4265-b269-9cf6abbf642e admin admin] The token cache is being invalidate because project 0cf3c18e3bef41efa6e6082be79785ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 03:59:20.201878 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [None req-7f4b837c-467d-4265-b269-9cf6abbf642e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 03:59:20.202533 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [None req-7f4b837c-467d-4265-b269-9cf6abbf642e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 03:59:20.204079 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 553/1127] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 03:59:20 2022] DELETE /identity/v3/projects/0cf3c18e3bef41efa6e6082be79785ac => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 03:59:29.732229 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=25 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 03:59:30.198575 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:00:39.847582 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2382b3-f1b0-42d3-be2e-bcb11740d46c None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:00:39.848346 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2382b3-f1b0-42d3-be2e-bcb11740d46c None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:00:39.848454 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2382b3-f1b0-42d3-be2e-bcb11740d46c None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:00:39.849741 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 575/1128] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 04:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 04:00:39.854481 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c95b15-3357-4c1a-b78c-269cd692770f None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:00:39.854951 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c95b15-3357-4c1a-b78c-269cd692770f None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:00:39.855079 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c95b15-3357-4c1a-b78c-269cd692770f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:00:39.922625 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-02c95b15-3357-4c1a-b78c-269cd692770f None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:00:39.923824 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-02c95b15-3357-4c1a-b78c-269cd692770f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:00:40.017506 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 554/1129] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 04:00:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:00:40.175123 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2382b3-f1b0-42d3-be2e-bcb11740d46c None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:00:40.176682 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-cb2382b3-f1b0-42d3-be2e-bcb11740d46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:00:40.263546 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2382b3-f1b0-42d3-be2e-bcb11740d46c None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:00:40.268593 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a2f15-9a05-4f96-8983-77a731187573 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:00:40.269218 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a2f15-9a05-4f96-8983-77a731187573 service nova] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:00:40.269500 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a2f15-9a05-4f96-8983-77a731187573 service nova] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:00:40.269776 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a2f15-9a05-4f96-8983-77a731187573 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:00:40.277927 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a2f15-9a05-4f96-8983-77a731187573 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:00:40.279504 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a2f15-9a05-4f96-8983-77a731187573 service nova] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:00:40.288533 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 576/1130] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:00:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:00:41.112373 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3592a-e4c6-43dc-aa7c-ce7add3e1103 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:00:41.112945 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3592a-e4c6-43dc-aa7c-ce7add3e1103 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:00:41.112945 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3592a-e4c6-43dc-aa7c-ce7add3e1103 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:00:41.114267 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 555/1131] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 04:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 04:00:41.119213 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e52c8-4885-4d46-bc95-8218a99d979b None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:00:41.119614 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e52c8-4885-4d46-bc95-8218a99d979b None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:00:41.119762 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e52c8-4885-4d46-bc95-8218a99d979b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:00:41.141756 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-394e52c8-4885-4d46-bc95-8218a99d979b None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:00:41.142975 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-394e52c8-4885-4d46-bc95-8218a99d979b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:00:41.150664 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 577/1132] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 04:00:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:00:41.307521 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3592a-e4c6-43dc-aa7c-ce7add3e1103 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:00:41.320872 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3592a-e4c6-43dc-aa7c-ce7add3e1103 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:00:41.325819 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9cfbb1-db79-4271-95e0-574bc9634038 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:00:41.326408 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cfbb1-db79-4271-95e0-574bc9634038 service nova] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:00:41.326684 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cfbb1-db79-4271-95e0-574bc9634038 service nova] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:00:41.326956 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cfbb1-db79-4271-95e0-574bc9634038 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:00:41.334830 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9cfbb1-db79-4271-95e0-574bc9634038 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:00:41.336416 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9cfbb1-db79-4271-95e0-574bc9634038 service nova] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:00:41.346020 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 556/1133] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:00:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:00:46.151030 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420886b0-9e2e-4991-b6ea-8c5c83d9dcd6 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:00:46.151578 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420886b0-9e2e-4991-b6ea-8c5c83d9dcd6 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:00:46.151578 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420886b0-9e2e-4991-b6ea-8c5c83d9dcd6 None None] PATH_INFO: `/v3` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:00:46.153457 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 578/1134] 10.222.0.15 () {54 vars in 925 bytes} [Fri Aug 19 04:00:46 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 04:00:46.182131 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f033c8-68d6-4a85-afb4-35adb7c43d71 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:00:46.182569 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f033c8-68d6-4a85-afb4-35adb7c43d71 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:00:46.182673 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f033c8-68d6-4a85-afb4-35adb7c43d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:00:46.211469 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-91f033c8-68d6-4a85-afb4-35adb7c43d71 None None] MFA Rules not processed for user `366baacae7c143929a64f5b639c17a99`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:00:46.212695 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-91f033c8-68d6-4a85-afb4-35adb7c43d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:00:46.265582 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:00:46.275012 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 557/1135] 10.222.0.15 () {58 vars in 1015 bytes} [Fri Aug 19 04:00:46 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:00:50.494946 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db988f4-2b83-48f5-8a43-23ee2caf25cc None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:00:50.495544 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db988f4-2b83-48f5-8a43-23ee2caf25cc None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:00:50.495544 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db988f4-2b83-48f5-8a43-23ee2caf25cc None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:00:50.496755 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 579/1136] 10.222.0.43 () {54 vars in 961 bytes} [Fri Aug 19 04:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 04:00:50.501785 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cb6bc-3478-4772-93f4-0a81256b6b3e None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:00:50.502227 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cb6bc-3478-4772-93f4-0a81256b6b3e None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:00:50.502340 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cb6bc-3478-4772-93f4-0a81256b6b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:00:50.521549 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-078cb6bc-3478-4772-93f4-0a81256b6b3e None None] MFA Rules not processed for user `366baacae7c143929a64f5b639c17a99`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:00:50.522721 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-078cb6bc-3478-4772-93f4-0a81256b6b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:00:50.531594 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 558/1137] 10.222.0.43 () {58 vars in 1058 bytes} [Fri Aug 19 04:00:50 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:00:50.600781 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db988f4-2b83-48f5-8a43-23ee2caf25cc None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:00:50.614916 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db988f4-2b83-48f5-8a43-23ee2caf25cc None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:00:50.619845 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f209aa02-1a82-4df0-9a18-a1ed9ff9478d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '366baacae7c143929a64f5b639c17a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:00:50.620440 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209aa02-1a82-4df0-9a18-a1ed9ff9478d service placement] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:00:50.620742 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209aa02-1a82-4df0-9a18-a1ed9ff9478d service placement] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:00:50.621023 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209aa02-1a82-4df0-9a18-a1ed9ff9478d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:00:50.629769 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f209aa02-1a82-4df0-9a18-a1ed9ff9478d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:00:50.631351 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f209aa02-1a82-4df0-9a18-a1ed9ff9478d service placement] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:00:50.640848 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 580/1138] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:00:50 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:00:52.570236 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19f342-5928-4e84-8867-553222e1afa9 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:00:52.570801 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19f342-5928-4e84-8867-553222e1afa9 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:00:52.570801 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19f342-5928-4e84-8867-553222e1afa9 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:00:52.572174 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 559/1139] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 04:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 04:00:52.577542 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063950e-a426-40ca-8f37-aed0b60e6ecb None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:00:52.577968 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063950e-a426-40ca-8f37-aed0b60e6ecb None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:00:52.578072 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063950e-a426-40ca-8f37-aed0b60e6ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:00:52.597292 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-5063950e-a426-40ca-8f37-aed0b60e6ecb None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:00:52.598725 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-5063950e-a426-40ca-8f37-aed0b60e6ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:00:52.606478 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 581/1140] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 04:00:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:00:52.764133 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19f342-5928-4e84-8867-553222e1afa9 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:00:52.778227 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19f342-5928-4e84-8867-553222e1afa9 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:00:52.783735 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bf489-67fb-40e6-87ea-96b23d61fb48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:00:52.784327 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bf489-67fb-40e6-87ea-96b23d61fb48 service nova] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:00:52.784632 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bf489-67fb-40e6-87ea-96b23d61fb48 service nova] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:00:52.784909 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bf489-67fb-40e6-87ea-96b23d61fb48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:00:52.792821 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806bf489-67fb-40e6-87ea-96b23d61fb48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:00:52.794391 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806bf489-67fb-40e6-87ea-96b23d61fb48 service nova] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:00:52.803496 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 560/1141] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:00:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:00:53.626340 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cb0e8-f9bb-46d9-96e3-9fb41f9064e4 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:00:53.626864 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cb0e8-f9bb-46d9-96e3-9fb41f9064e4 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:00:53.626964 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cb0e8-f9bb-46d9-96e3-9fb41f9064e4 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:00:53.628712 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 582/1142] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 04:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 04:00:53.633329 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84022e-9988-4715-bfb2-07780fc9546c None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:00:53.633740 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84022e-9988-4715-bfb2-07780fc9546c None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:00:53.633875 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84022e-9988-4715-bfb2-07780fc9546c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:00:53.653150 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-0b84022e-9988-4715-bfb2-07780fc9546c None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:00:53.654916 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-0b84022e-9988-4715-bfb2-07780fc9546c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:00:53.662500 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 561/1143] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 04:00:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:00:53.819449 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cb0e8-f9bb-46d9-96e3-9fb41f9064e4 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:00:53.832709 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cb0e8-f9bb-46d9-96e3-9fb41f9064e4 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:00:53.837554 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0f27c-90a7-4b55-a793-7ad302109ee7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:00:53.838144 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0f27c-90a7-4b55-a793-7ad302109ee7 service nova] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:00:53.838421 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0f27c-90a7-4b55-a793-7ad302109ee7 service nova] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:00:53.838695 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0f27c-90a7-4b55-a793-7ad302109ee7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:00:53.847152 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0f27c-90a7-4b55-a793-7ad302109ee7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:00:53.849029 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0f27c-90a7-4b55-a793-7ad302109ee7 service nova] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:00:53.858774 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 583/1144] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:00:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:00:57.896044 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9473c1c-394f-463e-b9d0-4cdfb7ef9d36 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:00:57.896666 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9473c1c-394f-463e-b9d0-4cdfb7ef9d36 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:00:57.896666 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9473c1c-394f-463e-b9d0-4cdfb7ef9d36 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:00:57.897985 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 562/1145] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 04:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 04:00:57.903177 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6593f7e-e0ea-4d41-b3c9-9431027ec6b1 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:00:57.903681 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6593f7e-e0ea-4d41-b3c9-9431027ec6b1 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:00:57.903778 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6593f7e-e0ea-4d41-b3c9-9431027ec6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:00:57.922950 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-b6593f7e-e0ea-4d41-b3c9-9431027ec6b1 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:00:57.924137 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-b6593f7e-e0ea-4d41-b3c9-9431027ec6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:00:57.931761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 584/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 04:00:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:00:58.279467 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9473c1c-394f-463e-b9d0-4cdfb7ef9d36 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:00:58.281165 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-a9473c1c-394f-463e-b9d0-4cdfb7ef9d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:00:58.336997 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9473c1c-394f-463e-b9d0-4cdfb7ef9d36 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:00:58.340476 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16a1ac-b475-4f9b-b7a7-2f702e8584f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:00:58.341609 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16a1ac-b475-4f9b-b7a7-2f702e8584f7 service neutron] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:00:58.341886 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16a1ac-b475-4f9b-b7a7-2f702e8584f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:00:58.342160 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16a1ac-b475-4f9b-b7a7-2f702e8584f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:00:58.350991 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16a1ac-b475-4f9b-b7a7-2f702e8584f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:00:58.352403 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16a1ac-b475-4f9b-b7a7-2f702e8584f7 service neutron] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:00:58.362066 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 563/1147] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:00:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:01:00.529700 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a619d-95c9-4c2a-9a78-537427af5475 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:01:00.530236 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a619d-95c9-4c2a-9a78-537427af5475 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:01:00.530236 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a619d-95c9-4c2a-9a78-537427af5475 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:01:00.531466 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 585/1148] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 04:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 04:01:00.536568 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82717a25-d1a7-458c-b4a7-94df80272eb4 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:01:00.536964 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82717a25-d1a7-458c-b4a7-94df80272eb4 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:01:00.537117 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82717a25-d1a7-458c-b4a7-94df80272eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:01:00.556574 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-82717a25-d1a7-458c-b4a7-94df80272eb4 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:01:00.557763 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-82717a25-d1a7-458c-b4a7-94df80272eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:01:00.565519 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 564/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 04:01:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 04:01:00.911516 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a619d-95c9-4c2a-9a78-537427af5475 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:01:00.913203 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-b00a619d-95c9-4c2a-9a78-537427af5475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:01:00.926237 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a619d-95c9-4c2a-9a78-537427af5475 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:01:00.931658 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247676bc-cc6a-4c43-a6df-4994c2790419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:01:00.932272 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247676bc-cc6a-4c43-a6df-4994c2790419 service neutron] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:01:00.932592 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247676bc-cc6a-4c43-a6df-4994c2790419 service neutron] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:01:00.932864 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247676bc-cc6a-4c43-a6df-4994c2790419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:01:00.942559 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247676bc-cc6a-4c43-a6df-4994c2790419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:01:00.944022 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247676bc-cc6a-4c43-a6df-4994c2790419 service neutron] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:01:00.953325 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 586/1150] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:01:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:01:04.707462 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ca207-e8dc-4805-ba0d-8d11e35d8195 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:01:04.707992 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ca207-e8dc-4805-ba0d-8d11e35d8195 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:01:04.707992 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ca207-e8dc-4805-ba0d-8d11e35d8195 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:01:04.709294 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 565/1151] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 04:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 04:01:04.714328 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b0fb7-1c3a-4792-bb23-634ea5c3c02f None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:01:04.714712 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b0fb7-1c3a-4792-bb23-634ea5c3c02f None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:01:04.714885 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b0fb7-1c3a-4792-bb23-634ea5c3c02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:01:04.735437 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-044b0fb7-1c3a-4792-bb23-634ea5c3c02f None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:01:04.736679 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-044b0fb7-1c3a-4792-bb23-634ea5c3c02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:01:04.748625 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 587/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 04:01:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:01:05.323379 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ca207-e8dc-4805-ba0d-8d11e35d8195 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:01:05.325068 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-e12ca207-e8dc-4805-ba0d-8d11e35d8195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:01:05.383000 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ca207-e8dc-4805-ba0d-8d11e35d8195 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:01:05.386539 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd5010-2d54-4e8a-b1dd-751a6e633dea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e8bf3b9cdd9431398a088815a44c8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:01:05.387131 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd5010-2d54-4e8a-b1dd-751a6e633dea service cinder] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:01:05.387410 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd5010-2d54-4e8a-b1dd-751a6e633dea service cinder] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:01:05.387681 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd5010-2d54-4e8a-b1dd-751a6e633dea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:01:05.396864 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd5010-2d54-4e8a-b1dd-751a6e633dea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:01:05.398289 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd5010-2d54-4e8a-b1dd-751a6e633dea service cinder] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:01:05.407965 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 566/1153] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:01:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:01:07.602209 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392b5f7-e03c-4335-b7b0-013debac8527 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:01:07.602755 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392b5f7-e03c-4335-b7b0-013debac8527 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:01:07.602755 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392b5f7-e03c-4335-b7b0-013debac8527 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:01:07.604021 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 588/1154] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 04:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 04:01:07.609738 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348086d-4efc-41c1-bd3f-eb496cf6ba27 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:01:07.610186 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348086d-4efc-41c1-bd3f-eb496cf6ba27 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:01:07.610292 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348086d-4efc-41c1-bd3f-eb496cf6ba27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:01:07.629729 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-f348086d-4efc-41c1-bd3f-eb496cf6ba27 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:01:07.630912 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-f348086d-4efc-41c1-bd3f-eb496cf6ba27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:01:07.638534 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 567/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 04:01:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:01:08.202056 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392b5f7-e03c-4335-b7b0-013debac8527 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:01:08.203739 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-5392b5f7-e03c-4335-b7b0-013debac8527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:01:08.216507 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392b5f7-e03c-4335-b7b0-013debac8527 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:01:08.220708 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d659a-cad7-48b3-a57c-d4d2232a7e7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e8bf3b9cdd9431398a088815a44c8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:01:08.221336 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d659a-cad7-48b3-a57c-d4d2232a7e7d service cinder] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:01:08.221609 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d659a-cad7-48b3-a57c-d4d2232a7e7d service cinder] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:01:08.221879 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d659a-cad7-48b3-a57c-d4d2232a7e7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:01:08.230970 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d659a-cad7-48b3-a57c-d4d2232a7e7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:01:08.232427 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d659a-cad7-48b3-a57c-d4d2232a7e7d service cinder] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:01:08.242147 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 589/1156] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:01:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:01:17.624909 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=70 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:01:18.238134 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=75 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:02:21.788995 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce1250-1b90-4c58-9b44-78a754c23cda None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:21.789683 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce1250-1b90-4c58-9b44-78a754c23cda None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:21.789683 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce1250-1b90-4c58-9b44-78a754c23cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:21.809161 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-82ce1250-1b90-4c58-9b44-78a754c23cda None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:02:21.810349 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed0dd8-8151-4080-b950-38a42c05c43f None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:21.810845 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-82ce1250-1b90-4c58-9b44-78a754c23cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:02:21.810948 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed0dd8-8151-4080-b950-38a42c05c43f None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:21.810948 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed0dd8-8151-4080-b950-38a42c05c43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:21.818766 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 568/1157] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 04:02:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:02:21.828416 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6e132-eaa8-4dfa-a08b-62b467778774 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:21.828730 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6e132-eaa8-4dfa-a08b-62b467778774 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:21.829003 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6e132-eaa8-4dfa-a08b-62b467778774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:21.831812 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-a2ed0dd8-8151-4080-b950-38a42c05c43f None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:02:21.833055 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-a2ed0dd8-8151-4080-b950-38a42c05c43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:02:21.840976 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 590/1158] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 04:02:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 04:02:21.848461 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-d4d6e132-eaa8-4dfa-a08b-62b467778774 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:02:21.849674 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-d4d6e132-eaa8-4dfa-a08b-62b467778774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:02:21.850061 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121294e-35dd-4207-9d82-093386ead009 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:21.850346 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121294e-35dd-4207-9d82-093386ead009 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:21.850621 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121294e-35dd-4207-9d82-093386ead009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:21.857466 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 569/1159] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 04:02:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 04:02:21.862511 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6e132-eaa8-4dfa-a08b-62b467778774 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:21.870253 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-8121294e-35dd-4207-9d82-093386ead009 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:02:21.871397 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6e132-eaa8-4dfa-a08b-62b467778774 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:21.871519 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-8121294e-35dd-4207-9d82-093386ead009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:02:21.875981 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07816961-e36c-4a4d-abf6-e2d46de98d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:21.876598 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07816961-e36c-4a4d-abf6-e2d46de98d32 admin admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:21.876875 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07816961-e36c-4a4d-abf6-e2d46de98d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:21.877149 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07816961-e36c-4a4d-abf6-e2d46de98d32 admin admin] PATH_INFO: `/v3/domains` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:21.877783 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07816961-e36c-4a4d-abf6-e2d46de98d32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 04:02:21.878089 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07816961-e36c-4a4d-abf6-e2d46de98d32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:21.879483 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 591/1160] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 04:02:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 04:02:21.879684 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07816961-e36c-4a4d-abf6-e2d46de98d32 admin admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:21.883999 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121294e-35dd-4207-9d82-093386ead009 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:21.891944 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 570/1161] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 04:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 04:02:21.894622 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121294e-35dd-4207-9d82-093386ead009 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:21.899310 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fe2c7-9e0a-4121-9425-92b3fcbb1816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:21.899597 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07816961-e36c-4a4d-abf6-e2d46de98d32 admin admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:21.899900 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fe2c7-9e0a-4121-9425-92b3fcbb1816 admin admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:21.900186 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fe2c7-9e0a-4121-9425-92b3fcbb1816 admin admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:21.900464 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fe2c7-9e0a-4121-9425-92b3fcbb1816 admin admin] PATH_INFO: `/v3/domains` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:21.901130 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fe2c7-9e0a-4121-9425-92b3fcbb1816 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 04:02:21.901433 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fe2c7-9e0a-4121-9425-92b3fcbb1816 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:21.902443 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: WARNING py.warnings [None req-077fe2c7-9e0a-4121-9425-92b3fcbb1816 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 04:02:21.902443 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: warnings.warn(msg) Aug 19 04:02:21.902443 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: Aug 19 04:02:21.903332 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fe2c7-9e0a-4121-9425-92b3fcbb1816 admin admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:21.909832 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07816961-e36c-4a4d-abf6-e2d46de98d32 admin admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:21.914413 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a87f0c-edc7-4670-b3bf-904a9f8ad364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:21.914994 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a87f0c-edc7-4670-b3bf-904a9f8ad364 admin admin] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:21.915269 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a87f0c-edc7-4670-b3bf-904a9f8ad364 admin admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:21.915624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 592/1162] 10.222.0.43 () {58 vars in 1153 bytes} [Fri Aug 19 04:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 04:02:21.916619 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a87f0c-edc7-4670-b3bf-904a9f8ad364 admin admin] PATH_INFO: `/v3/projects` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:21.917332 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a87f0c-edc7-4670-b3bf-904a9f8ad364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:21.918569 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: WARNING py.warnings [None req-d2a87f0c-edc7-4670-b3bf-904a9f8ad364 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 04:02:21.918569 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: warnings.warn(msg) Aug 19 04:02:21.918569 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: Aug 19 04:02:21.919978 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a87f0c-edc7-4670-b3bf-904a9f8ad364 admin admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:21.923294 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fe2c7-9e0a-4121-9425-92b3fcbb1816 admin admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:21.933111 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fe2c7-9e0a-4121-9425-92b3fcbb1816 admin admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:21.937794 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218889b-8708-4ade-8bc7-7d15d857e99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:21.938369 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218889b-8708-4ade-8bc7-7d15d857e99c admin admin] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:21.938639 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218889b-8708-4ade-8bc7-7d15d857e99c admin admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:21.938904 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218889b-8708-4ade-8bc7-7d15d857e99c admin admin] PATH_INFO: `/v3/projects` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:21.939506 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218889b-8708-4ade-8bc7-7d15d857e99c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:21.941431 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218889b-8708-4ade-8bc7-7d15d857e99c admin admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:21.957371 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 571/1163] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 04:02:21 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 04:02:21.961869 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a87f0c-edc7-4670-b3bf-904a9f8ad364 admin admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:21.971240 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 593/1164] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 04:02:21 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 04:02:21.975574 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218889b-8708-4ade-8bc7-7d15d857e99c admin admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:22.025303 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a87f0c-edc7-4670-b3bf-904a9f8ad364 admin admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:22.035788 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218889b-8708-4ade-8bc7-7d15d857e99c admin admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:22.040893 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8196d-501c-48c0-a5d0-46b8369ab091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:22.041431 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8196d-501c-48c0-a5d0-46b8369ab091 admin admin] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:22.041718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8196d-501c-48c0-a5d0-46b8369ab091 admin admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:22.041993 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8196d-501c-48c0-a5d0-46b8369ab091 admin admin] PATH_INFO: `/v3/users` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:22.042609 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8196d-501c-48c0-a5d0-46b8369ab091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:22.043622 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: WARNING py.warnings [None req-b0b8196d-501c-48c0-a5d0-46b8369ab091 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 04:02:22.043622 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: warnings.warn(msg) Aug 19 04:02:22.043622 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: Aug 19 04:02:22.044911 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8196d-501c-48c0-a5d0-46b8369ab091 admin admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:22.064982 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 594/1165] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 04:02:21 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 04:02:22.068948 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8196d-501c-48c0-a5d0-46b8369ab091 admin admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:22.078892 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8196d-501c-48c0-a5d0-46b8369ab091 admin admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:22.083195 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e6b91-f1a1-4b10-85b7-ca3809825d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:22.083800 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e6b91-f1a1-4b10-85b7-ca3809825d86 admin admin] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:22.083977 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf3004-7d02-4a83-be03-c2fb2d8b5730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:22.084103 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e6b91-f1a1-4b10-85b7-ca3809825d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:22.084332 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e6b91-f1a1-4b10-85b7-ca3809825d86 admin admin] PATH_INFO: `/v3/users` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:22.084574 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf3004-7d02-4a83-be03-c2fb2d8b5730 admin admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:22.084958 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf3004-7d02-4a83-be03-c2fb2d8b5730 admin admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:22.085074 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e6b91-f1a1-4b10-85b7-ca3809825d86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:22.085216 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf3004-7d02-4a83-be03-c2fb2d8b5730 admin admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:22.085841 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf3004-7d02-4a83-be03-c2fb2d8b5730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:22.086881 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e6b91-f1a1-4b10-85b7-ca3809825d86 admin admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:22.087414 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf3004-7d02-4a83-be03-c2fb2d8b5730 admin admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:22.098511 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 595/1166] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 04:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 04:02:22.102761 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf3004-7d02-4a83-be03-c2fb2d8b5730 admin admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:22.110359 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 572/1167] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 04:02:21 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 04:02:22.112900 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf3004-7d02-4a83-be03-c2fb2d8b5730 admin admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:22.114269 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e6b91-f1a1-4b10-85b7-ca3809825d86 admin admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:22.117615 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4729ddf-0019-4878-919a-2e68d3d57a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:22.118202 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4729ddf-0019-4878-919a-2e68d3d57a9a admin admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:22.118483 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4729ddf-0019-4878-919a-2e68d3d57a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:22.118762 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4729ddf-0019-4878-919a-2e68d3d57a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:22.119400 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4729ddf-0019-4878-919a-2e68d3d57a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:22.121059 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4729ddf-0019-4878-919a-2e68d3d57a9a admin admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:22.124230 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e6b91-f1a1-4b10-85b7-ca3809825d86 admin admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:22.128856 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98334e-8bfc-471b-a2ad-cccff2944c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:22.129437 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98334e-8bfc-471b-a2ad-cccff2944c01 admin admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:22.129719 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98334e-8bfc-471b-a2ad-cccff2944c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:22.129990 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98334e-8bfc-471b-a2ad-cccff2944c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:22.130614 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98334e-8bfc-471b-a2ad-cccff2944c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:22.135173 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 596/1168] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 04:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 04:02:22.135307 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98334e-8bfc-471b-a2ad-cccff2944c01 admin admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:22.136431 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4729ddf-0019-4878-919a-2e68d3d57a9a admin admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:22.148541 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 573/1169] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 04:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 04:02:22.148724 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4729ddf-0019-4878-919a-2e68d3d57a9a admin admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:22.149474 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98334e-8bfc-471b-a2ad-cccff2944c01 admin admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:22.151636 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7cf8d-06b0-453a-80b1-80d4da1f71a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:22.152274 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7cf8d-06b0-453a-80b1-80d4da1f71a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:22.152645 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7cf8d-06b0-453a-80b1-80d4da1f71a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:22.152921 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7cf8d-06b0-453a-80b1-80d4da1f71a7 admin admin] PATH_INFO: `/v3/projects/6a3e3e3893104e46bf3bf7952f4857fa/users/1419252d53a3455f982ad2aafa3624a7/roles/eaf433778e9e4d44bf6d1a1ea65d983f` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:22.158897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98334e-8bfc-471b-a2ad-cccff2944c01 admin admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:22.164007 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0174323-9fbb-4a06-9944-343da9a84f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:22.164782 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0174323-9fbb-4a06-9944-343da9a84f8e admin admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:22.165059 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0174323-9fbb-4a06-9944-343da9a84f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:22.165338 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0174323-9fbb-4a06-9944-343da9a84f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:22.165976 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0174323-9fbb-4a06-9944-343da9a84f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:22.167516 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7cf8d-06b0-453a-80b1-80d4da1f71a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a3e3e3893104e46bf3bf7952f4857fa, user_id=1419252d53a3455f982ad2aafa3624a7, role_id=eaf433778e9e4d44bf6d1a1ea65d983f)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:22.167643 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0174323-9fbb-4a06-9944-343da9a84f8e admin admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:22.170261 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7cf8d-06b0-453a-80b1-80d4da1f71a7 admin admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:22.182606 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 574/1170] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 04:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 04:02:22.184054 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 597/1171] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 04:02:22 2022] PUT /identity/v3/projects/6a3e3e3893104e46bf3bf7952f4857fa/users/1419252d53a3455f982ad2aafa3624a7/roles/eaf433778e9e4d44bf6d1a1ea65d983f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 04:02:22.187368 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0174323-9fbb-4a06-9944-343da9a84f8e admin admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:22.189553 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5312626-32e7-49b6-b487-438328fcd82b None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:22.189835 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5312626-32e7-49b6-b487-438328fcd82b None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:22.190106 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5312626-32e7-49b6-b487-438328fcd82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:22.197269 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0174323-9fbb-4a06-9944-343da9a84f8e admin admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:22.208831 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-f5312626-32e7-49b6-b487-438328fcd82b None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:02:22.209951 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:02:22.210098 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-f5312626-32e7-49b6-b487-438328fcd82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:02:22.257362 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:02:22.259719 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a715de1-66bf-40a3-9670-9b6751cd0ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:22.260454 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a715de1-66bf-40a3-9670-9b6751cd0ab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:22.260823 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a715de1-66bf-40a3-9670-9b6751cd0ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:22.261107 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a715de1-66bf-40a3-9670-9b6751cd0ab0 admin admin] PATH_INFO: `/v3/projects/416df27f835549a7bb62de5ce68fcb75/users/32125988f4354e7d8559e08e445cb622/roles/eaf433778e9e4d44bf6d1a1ea65d983f` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:22.271671 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 598/1172] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 04:02:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:02:22.276560 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a715de1-66bf-40a3-9670-9b6751cd0ab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=416df27f835549a7bb62de5ce68fcb75, user_id=32125988f4354e7d8559e08e445cb622, role_id=eaf433778e9e4d44bf6d1a1ea65d983f)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:22.277891 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: WARNING py.warnings [None req-2a715de1-66bf-40a3-9670-9b6751cd0ab0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 04:02:22.277891 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: warnings.warn(msg) Aug 19 04:02:22.277891 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: Aug 19 04:02:22.279892 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a715de1-66bf-40a3-9670-9b6751cd0ab0 admin admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:22.281876 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5312626-32e7-49b6-b487-438328fcd82b None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:22.294087 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 575/1173] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 04:02:22 2022] PUT /identity/v3/projects/416df27f835549a7bb62de5ce68fcb75/users/32125988f4354e7d8559e08e445cb622/roles/eaf433778e9e4d44bf6d1a1ea65d983f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 04:02:22.298426 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334992d7-d7ce-4b25-9767-e0aed81858c4 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:22.298742 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334992d7-d7ce-4b25-9767-e0aed81858c4 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:22.299023 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334992d7-d7ce-4b25-9767-e0aed81858c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:22.317675 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-334992d7-d7ce-4b25-9767-e0aed81858c4 None None] MFA Rules not processed for user `3297fc4b647c4c1aa4dde010a58c50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:02:22.318875 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-334992d7-d7ce-4b25-9767-e0aed81858c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:02:22.343092 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5312626-32e7-49b6-b487-438328fcd82b None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:22.376281 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 576/1174] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 04:02:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 04:02:22.387533 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334992d7-d7ce-4b25-9767-e0aed81858c4 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:22.391924 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a0641-8c51-4862-887f-c94017fa28a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:22.392569 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a0641-8c51-4862-887f-c94017fa28a8 service neutron] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:22.392852 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a0641-8c51-4862-887f-c94017fa28a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:22.393129 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a0641-8c51-4862-887f-c94017fa28a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:22.397431 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334992d7-d7ce-4b25-9767-e0aed81858c4 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:22.401088 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50736d28-9869-4333-951f-75ab88fc41be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:22.401740 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50736d28-9869-4333-951f-75ab88fc41be service neutron] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:22.402079 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50736d28-9869-4333-951f-75ab88fc41be service neutron] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:22.402254 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a0641-8c51-4862-887f-c94017fa28a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:22.402491 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50736d28-9869-4333-951f-75ab88fc41be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:22.403712 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a0641-8c51-4862-887f-c94017fa28a8 service neutron] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:22.411258 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50736d28-9869-4333-951f-75ab88fc41be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:22.412774 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50736d28-9869-4333-951f-75ab88fc41be service neutron] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:22.413151 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 599/1175] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:02:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 04:02:22.422393 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 577/1176] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:02:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 04:02:26.887090 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e88aa7-ac48-4c1e-9130-fa34b288ea84 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:26.887639 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e88aa7-ac48-4c1e-9130-fa34b288ea84 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:26.887928 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e88aa7-ac48-4c1e-9130-fa34b288ea84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:26.960918 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-a7e88aa7-ac48-4c1e-9130-fa34b288ea84 None None] MFA Rules not processed for user `1419252d53a3455f982ad2aafa3624a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:02:26.973807 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-a7e88aa7-ac48-4c1e-9130-fa34b288ea84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:02:27.161980 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 600/1177] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 04:02:26 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:02:27.163265 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50736d28-9869-4333-951f-75ab88fc41be service neutron] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:27.179440 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50736d28-9869-4333-951f-75ab88fc41be service neutron] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:27.191760 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bf8c7-c163-4a72-8b4e-08f62dbcafe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:27.193356 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bf8c7-c163-4a72-8b4e-08f62dbcafe1 admin admin] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:27.193639 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bf8c7-c163-4a72-8b4e-08f62dbcafe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:27.193915 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bf8c7-c163-4a72-8b4e-08f62dbcafe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:27.195060 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bf8c7-c163-4a72-8b4e-08f62dbcafe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:27.197073 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bf8c7-c163-4a72-8b4e-08f62dbcafe1 admin admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:27.259133 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 578/1178] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 04:02:27 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 04:02:27.262991 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e88aa7-ac48-4c1e-9130-fa34b288ea84 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:27.276313 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e88aa7-ac48-4c1e-9130-fa34b288ea84 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:27.353066 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:02:27.394311 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9178d-5968-44e6-8935-64768e1b8078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:27.395601 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9178d-5968-44e6-8935-64768e1b8078 admin admin] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:27.395601 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9178d-5968-44e6-8935-64768e1b8078 admin admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:27.396035 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9178d-5968-44e6-8935-64768e1b8078 admin admin] PATH_INFO: `/v3/users` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:27.396820 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9178d-5968-44e6-8935-64768e1b8078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:27.399031 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9178d-5968-44e6-8935-64768e1b8078 admin admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:27.436625 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 601/1179] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 04:02:27 2022] POST /identity/v3/users => generated 299 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 04:02:27.437259 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bf8c7-c163-4a72-8b4e-08f62dbcafe1 admin admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:27.451990 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bf8c7-c163-4a72-8b4e-08f62dbcafe1 admin admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:27.457391 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403e359-e3f7-4fe5-803e-7edcc123348a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:27.458279 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403e359-e3f7-4fe5-803e-7edcc123348a admin admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:27.458623 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403e359-e3f7-4fe5-803e-7edcc123348a admin admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:27.458974 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403e359-e3f7-4fe5-803e-7edcc123348a admin admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:27.459886 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403e359-e3f7-4fe5-803e-7edcc123348a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:27.466685 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403e359-e3f7-4fe5-803e-7edcc123348a admin admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:27.481055 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 579/1180] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 04:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 04:02:27.486045 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9178d-5968-44e6-8935-64768e1b8078 admin admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:27.498270 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9178d-5968-44e6-8935-64768e1b8078 admin admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:27.509820 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40bee8-0291-4327-b4a1-b34a3f4aa781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:27.510904 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40bee8-0291-4327-b4a1-b34a3f4aa781 admin admin] REQUEST_METHOD: `PUT` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:27.511368 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40bee8-0291-4327-b4a1-b34a3f4aa781 admin admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:27.516425 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40bee8-0291-4327-b4a1-b34a3f4aa781 admin admin] PATH_INFO: `/v3/projects/e1e59139f59040d39a5d73080f22a27e/users/95337b59e45f407c977d795e1281623b/roles/e154509f216e4ae59f74044aa234ddde` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:27.538250 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40bee8-0291-4327-b4a1-b34a3f4aa781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e59139f59040d39a5d73080f22a27e, user_id=95337b59e45f407c977d795e1281623b, role_id=e154509f216e4ae59f74044aa234ddde)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:27.541557 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40bee8-0291-4327-b4a1-b34a3f4aa781 admin admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:27.563453 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 602/1181] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 04:02:27 2022] PUT /identity/v3/projects/e1e59139f59040d39a5d73080f22a27e/users/95337b59e45f407c977d795e1281623b/roles/e154509f216e4ae59f74044aa234ddde => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 04:02:27.567271 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403e359-e3f7-4fe5-803e-7edcc123348a admin admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:27.583250 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403e359-e3f7-4fe5-803e-7edcc123348a admin admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:27.689835 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:02:27.709860 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f7d3b-575b-4669-ae67-12d1db8bbc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:27.710526 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f7d3b-575b-4669-ae67-12d1db8bbc8a admin admin] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:27.710803 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f7d3b-575b-4669-ae67-12d1db8bbc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:27.711135 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f7d3b-575b-4669-ae67-12d1db8bbc8a admin admin] PATH_INFO: `/v3/roles` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:27.711790 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f7d3b-575b-4669-ae67-12d1db8bbc8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:27.713805 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f7d3b-575b-4669-ae67-12d1db8bbc8a admin admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:27.733680 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 580/1182] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 04:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 04:02:27.737631 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40bee8-0291-4327-b4a1-b34a3f4aa781 admin admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:27.753545 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40bee8-0291-4327-b4a1-b34a3f4aa781 admin admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:27.767739 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8ebc9-5b47-43b8-b80f-14fb16d125f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:27.768437 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8ebc9-5b47-43b8-b80f-14fb16d125f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:27.768764 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8ebc9-5b47-43b8-b80f-14fb16d125f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:27.769041 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8ebc9-5b47-43b8-b80f-14fb16d125f0 admin admin] PATH_INFO: `/v3/projects/e1e59139f59040d39a5d73080f22a27e/users/95337b59e45f407c977d795e1281623b/roles/e154509f216e4ae59f74044aa234ddde` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:27.773323 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8ebc9-5b47-43b8-b80f-14fb16d125f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e59139f59040d39a5d73080f22a27e, user_id=95337b59e45f407c977d795e1281623b, role_id=e154509f216e4ae59f74044aa234ddde)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:27.775959 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8ebc9-5b47-43b8-b80f-14fb16d125f0 admin admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:27.801473 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 603/1183] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 04:02:27 2022] PUT /identity/v3/projects/e1e59139f59040d39a5d73080f22a27e/users/95337b59e45f407c977d795e1281623b/roles/e154509f216e4ae59f74044aa234ddde => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 04:02:27.993221 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b047252-af9a-4c7a-b376-aa1d4f68143c None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:27.993503 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b047252-af9a-4c7a-b376-aa1d4f68143c None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:27.993779 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b047252-af9a-4c7a-b376-aa1d4f68143c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:28.046853 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-4b047252-af9a-4c7a-b376-aa1d4f68143c None None] MFA Rules not processed for user `32125988f4354e7d8559e08e445cb622`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:02:28.048338 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-4b047252-af9a-4c7a-b376-aa1d4f68143c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:02:28.136531 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 581/1184] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 04:02:27 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:02:28.138191 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8ebc9-5b47-43b8-b80f-14fb16d125f0 admin admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:28.235143 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8ebc9-5b47-43b8-b80f-14fb16d125f0 admin admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:28.240800 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a035b0-129f-4c9c-b3e1-48e82bea9278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:28.241506 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a035b0-129f-4c9c-b3e1-48e82bea9278 admin admin] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:28.241850 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a035b0-129f-4c9c-b3e1-48e82bea9278 admin admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:28.242497 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a035b0-129f-4c9c-b3e1-48e82bea9278 admin admin] PATH_INFO: `/v3/projects` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:28.242881 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a035b0-129f-4c9c-b3e1-48e82bea9278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:28.245024 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a035b0-129f-4c9c-b3e1-48e82bea9278 admin admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:28.291809 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 604/1185] 10.222.0.43 () {60 vars in 1153 bytes} [Fri Aug 19 04:02:28 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 04:02:28.293026 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b047252-af9a-4c7a-b376-aa1d4f68143c None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:28.311076 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b047252-af9a-4c7a-b376-aa1d4f68143c None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:28.390377 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449f541-f984-4e36-a853-0c11e830ecba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:28.391409 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449f541-f984-4e36-a853-0c11e830ecba admin admin] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:28.391898 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449f541-f984-4e36-a853-0c11e830ecba admin admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:28.392431 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449f541-f984-4e36-a853-0c11e830ecba admin admin] PATH_INFO: `/v3/users` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:28.393352 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449f541-f984-4e36-a853-0c11e830ecba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:28.395897 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449f541-f984-4e36-a853-0c11e830ecba admin admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:28.425277 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 582/1186] 10.222.0.43 () {60 vars in 1144 bytes} [Fri Aug 19 04:02:28 2022] POST /identity/v3/users => generated 296 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 04:02:28.426603 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a035b0-129f-4c9c-b3e1-48e82bea9278 admin admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:28.444826 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a035b0-129f-4c9c-b3e1-48e82bea9278 admin admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:28.449988 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c3f79-0f16-4839-8ac0-cd78250ef1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:28.451358 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c3f79-0f16-4839-8ac0-cd78250ef1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:28.451675 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c3f79-0f16-4839-8ac0-cd78250ef1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:28.451957 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c3f79-0f16-4839-8ac0-cd78250ef1d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:28.452683 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c3f79-0f16-4839-8ac0-cd78250ef1d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:28.454325 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c3f79-0f16-4839-8ac0-cd78250ef1d8 admin admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:28.473886 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 605/1187] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 04:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 04:02:28.477769 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449f541-f984-4e36-a853-0c11e830ecba admin admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:28.488594 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449f541-f984-4e36-a853-0c11e830ecba admin admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:28.494067 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec2ee6-00b2-480b-99d1-1c40fd40d8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:28.494753 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec2ee6-00b2-480b-99d1-1c40fd40d8d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:28.495037 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec2ee6-00b2-480b-99d1-1c40fd40d8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:28.495320 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec2ee6-00b2-480b-99d1-1c40fd40d8d7 admin admin] PATH_INFO: `/v3/projects/3b7f1342961b4dba998564d8c1f94354/users/d39243349b404b7ba85383caca3f6070/roles/e154509f216e4ae59f74044aa234ddde` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:28.524436 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec2ee6-00b2-480b-99d1-1c40fd40d8d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b7f1342961b4dba998564d8c1f94354, user_id=d39243349b404b7ba85383caca3f6070, role_id=e154509f216e4ae59f74044aa234ddde)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:28.527414 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec2ee6-00b2-480b-99d1-1c40fd40d8d7 admin admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:28.548000 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 583/1188] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 04:02:28 2022] PUT /identity/v3/projects/3b7f1342961b4dba998564d8c1f94354/users/d39243349b404b7ba85383caca3f6070/roles/e154509f216e4ae59f74044aa234ddde => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 04:02:28.551964 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c3f79-0f16-4839-8ac0-cd78250ef1d8 admin admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:28.562982 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c3f79-0f16-4839-8ac0-cd78250ef1d8 admin admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:28.639208 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6433a07-ddc0-462c-8e45-fb555868027b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:28.640034 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6433a07-ddc0-462c-8e45-fb555868027b admin admin] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:28.640320 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6433a07-ddc0-462c-8e45-fb555868027b admin admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:28.640642 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6433a07-ddc0-462c-8e45-fb555868027b admin admin] PATH_INFO: `/v3/roles` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:28.641476 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6433a07-ddc0-462c-8e45-fb555868027b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:28.643150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6433a07-ddc0-462c-8e45-fb555868027b admin admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:28.660611 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 606/1189] 10.222.0.43 () {58 vars in 1122 bytes} [Fri Aug 19 04:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 04:02:28.664518 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec2ee6-00b2-480b-99d1-1c40fd40d8d7 admin admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:28.687054 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec2ee6-00b2-480b-99d1-1c40fd40d8d7 admin admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:28.692111 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb89b8-7b7d-4868-9e62-c3d35585c94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:28.693461 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb89b8-7b7d-4868-9e62-c3d35585c94c admin admin] REQUEST_METHOD: `PUT` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:28.693743 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb89b8-7b7d-4868-9e62-c3d35585c94c admin admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:28.694024 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb89b8-7b7d-4868-9e62-c3d35585c94c admin admin] PATH_INFO: `/v3/projects/3b7f1342961b4dba998564d8c1f94354/users/d39243349b404b7ba85383caca3f6070/roles/e154509f216e4ae59f74044aa234ddde` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:28.696941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb89b8-7b7d-4868-9e62-c3d35585c94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b7f1342961b4dba998564d8c1f94354, user_id=d39243349b404b7ba85383caca3f6070, role_id=e154509f216e4ae59f74044aa234ddde)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:28.703558 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb89b8-7b7d-4868-9e62-c3d35585c94c admin admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:28.725016 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 584/1190] 10.222.0.43 () {60 vars in 1483 bytes} [Fri Aug 19 04:02:28 2022] PUT /identity/v3/projects/3b7f1342961b4dba998564d8c1f94354/users/d39243349b404b7ba85383caca3f6070/roles/e154509f216e4ae59f74044aa234ddde => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 04:02:33.688846 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a964cc-48d7-46e6-af3a-e29e43892cd9 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:33.689395 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a964cc-48d7-46e6-af3a-e29e43892cd9 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:33.689615 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a964cc-48d7-46e6-af3a-e29e43892cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:33.709670 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:02:33.744506 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-d3a964cc-48d7-46e6-af3a-e29e43892cd9 None None] MFA Rules not processed for user `95337b59e45f407c977d795e1281623b`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:02:33.746863 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-d3a964cc-48d7-46e6-af3a-e29e43892cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:02:33.925206 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 607/1191] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 04:02:33 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:02:33.937989 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb89b8-7b7d-4868-9e62-c3d35585c94c admin admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:33.939805 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-57eb89b8-7b7d-4868-9e62-c3d35585c94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:02:33.982049 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:02:34.025434 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb89b8-7b7d-4868-9e62-c3d35585c94c admin admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:34.030185 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e559e-dfe1-46c3-bc7b-e7ba60c9268c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfee7b193add48478b5240198b1aa602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:34.030915 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e559e-dfe1-46c3-bc7b-e7ba60c9268c service glance] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:34.031240 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e559e-dfe1-46c3-bc7b-e7ba60c9268c service glance] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:34.031523 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e559e-dfe1-46c3-bc7b-e7ba60c9268c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:34.099489 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e559e-dfe1-46c3-bc7b-e7ba60c9268c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:34.100946 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e559e-dfe1-46c3-bc7b-e7ba60c9268c service glance] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:34.122074 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 585/1192] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:02:33 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:02:34.783461 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6d818-cf0b-4c90-8757-a08d27968f92 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:34.784036 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6d818-cf0b-4c90-8757-a08d27968f92 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:34.784036 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6d818-cf0b-4c90-8757-a08d27968f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:34.849714 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-c1e6d818-cf0b-4c90-8757-a08d27968f92 None None] MFA Rules not processed for user `d39243349b404b7ba85383caca3f6070`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:02:34.850955 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-c1e6d818-cf0b-4c90-8757-a08d27968f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:02:35.011810 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 608/1193] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 04:02:34 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:02:35.021557 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e559e-dfe1-46c3-bc7b-e7ba60c9268c service glance] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:35.040102 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e559e-dfe1-46c3-bc7b-e7ba60c9268c service glance] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:35.050658 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a62fcc-2603-4807-97a6-e25abbff7a3d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfee7b193add48478b5240198b1aa602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:35.056524 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a62fcc-2603-4807-97a6-e25abbff7a3d service glance] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:35.059053 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a62fcc-2603-4807-97a6-e25abbff7a3d service glance] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:35.059919 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a62fcc-2603-4807-97a6-e25abbff7a3d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:35.186277 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a62fcc-2603-4807-97a6-e25abbff7a3d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:35.187896 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a62fcc-2603-4807-97a6-e25abbff7a3d service glance] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:35.204783 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 586/1194] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:02:35 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 04:02:42.891541 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade2a17-1d0f-4e3f-b1db-8d0977955aae None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:42.892150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade2a17-1d0f-4e3f-b1db-8d0977955aae None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:42.892150 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade2a17-1d0f-4e3f-b1db-8d0977955aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:42.920332 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-2ade2a17-1d0f-4e3f-b1db-8d0977955aae None None] MFA Rules not processed for user `1419252d53a3455f982ad2aafa3624a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:02:42.921802 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-2ade2a17-1d0f-4e3f-b1db-8d0977955aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:02:42.932529 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 609/1195] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 04:02:42 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:02:43.306941 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131e1ac-2350-4949-9454-2a804e3925f2 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:43.307608 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131e1ac-2350-4949-9454-2a804e3925f2 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:43.307908 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131e1ac-2350-4949-9454-2a804e3925f2 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:43.309910 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 587/1196] 10.222.0.43 () {54 vars in 962 bytes} [Fri Aug 19 04:02:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 04:02:43.320299 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df76f44-4d5f-461c-adbc-ed43019e2799 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:43.320709 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df76f44-4d5f-461c-adbc-ed43019e2799 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:43.321411 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df76f44-4d5f-461c-adbc-ed43019e2799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:43.363693 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-8df76f44-4d5f-461c-adbc-ed43019e2799 None None] MFA Rules not processed for user `7aab3a88f9d0401db32fbaadef2711ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:02:43.365199 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-8df76f44-4d5f-461c-adbc-ed43019e2799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:02:43.431944 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=100 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:02:43.448147 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 610/1197] 10.222.0.43 () {58 vars in 1059 bytes} [Fri Aug 19 04:02:43 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:02:43.454362 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b45f96-212b-419b-9633-8248763a6cfb None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:43.454913 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b45f96-212b-419b-9633-8248763a6cfb None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:43.455277 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b45f96-212b-419b-9633-8248763a6cfb None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:43.456917 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 588/1198] 10.222.0.43 () {54 vars in 912 bytes} [Fri Aug 19 04:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 04:02:43.461642 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30723a-aee3-4b9e-bd33-aed9d8e2db6a None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:43.462087 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30723a-aee3-4b9e-bd33-aed9d8e2db6a None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:43.462510 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30723a-aee3-4b9e-bd33-aed9d8e2db6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:43.485074 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-1b30723a-aee3-4b9e-bd33-aed9d8e2db6a None None] MFA Rules not processed for user `7aab3a88f9d0401db32fbaadef2711ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:02:43.486282 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-1b30723a-aee3-4b9e-bd33-aed9d8e2db6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:02:43.496327 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 611/1199] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Aug 19 04:02:43 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:02:43.509718 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b45f96-212b-419b-9633-8248763a6cfb None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:43.511610 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-71b45f96-212b-419b-9633-8248763a6cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:02:43.526416 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b45f96-212b-419b-9633-8248763a6cfb None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:43.531937 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9ded4-6410-4405-94f5-6cc8e874cbaf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfee7b193add48478b5240198b1aa602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:43.532576 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9ded4-6410-4405-94f5-6cc8e874cbaf service glance] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:43.532862 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9ded4-6410-4405-94f5-6cc8e874cbaf service glance] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:43.533142 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9ded4-6410-4405-94f5-6cc8e874cbaf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:43.543540 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9ded4-6410-4405-94f5-6cc8e874cbaf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:43.545085 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9ded4-6410-4405-94f5-6cc8e874cbaf service glance] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:43.558115 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 589/1200] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:02:43 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:02:43.932769 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf4034-f16e-4ff8-8ea6-6b30d2561df5 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:43.933364 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf4034-f16e-4ff8-8ea6-6b30d2561df5 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:43.933364 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf4034-f16e-4ff8-8ea6-6b30d2561df5 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:43.935202 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 612/1201] 10.222.0.43 () {54 vars in 912 bytes} [Fri Aug 19 04:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 04:02:43.941057 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3967ad-d42d-4e55-99b4-e6fa8a34da52 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:43.941561 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3967ad-d42d-4e55-99b4-e6fa8a34da52 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:43.942798 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3967ad-d42d-4e55-99b4-e6fa8a34da52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:43.983667 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-5e3967ad-d42d-4e55-99b4-e6fa8a34da52 None None] MFA Rules not processed for user `00454605826e4d6593d2d6aa331ebdc6`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:02:43.985201 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-5e3967ad-d42d-4e55-99b4-e6fa8a34da52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:02:44.044801 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=100 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:02:44.052065 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 590/1202] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Aug 19 04:02:43 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:02:44.065123 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf4034-f16e-4ff8-8ea6-6b30d2561df5 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:44.079131 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf4034-f16e-4ff8-8ea6-6b30d2561df5 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:44.083276 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c75be8-7d53-48c9-ac1c-f6f09ba21117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:44.084076 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c75be8-7d53-48c9-ac1c-f6f09ba21117 service neutron] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:44.084506 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c75be8-7d53-48c9-ac1c-f6f09ba21117 service neutron] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:44.084803 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c75be8-7d53-48c9-ac1c-f6f09ba21117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:44.092225 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c75be8-7d53-48c9-ac1c-f6f09ba21117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:44.093921 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c75be8-7d53-48c9-ac1c-f6f09ba21117 service neutron] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:44.102845 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 613/1203] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:02:44 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:02:44.555438 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08c95c-0f3f-4193-a360-d723933abdc8 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:44.555937 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08c95c-0f3f-4193-a360-d723933abdc8 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:44.555937 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08c95c-0f3f-4193-a360-d723933abdc8 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:44.557618 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 591/1204] 10.222.0.43 () {54 vars in 962 bytes} [Fri Aug 19 04:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 04:02:44.567680 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32db79-6202-4f3a-a57c-e862abe7dbb9 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:44.567969 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32db79-6202-4f3a-a57c-e862abe7dbb9 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:44.568239 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32db79-6202-4f3a-a57c-e862abe7dbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:44.572872 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08c95c-0f3f-4193-a360-d723933abdc8 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:44.589688 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-3b32db79-6202-4f3a-a57c-e862abe7dbb9 None None] MFA Rules not processed for user `7aab3a88f9d0401db32fbaadef2711ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:02:44.591512 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-3b32db79-6202-4f3a-a57c-e862abe7dbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:02:44.600987 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 614/1205] 10.222.0.43 () {58 vars in 1059 bytes} [Fri Aug 19 04:02:44 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 04:02:44.609171 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc6f81-9309-4ad7-949e-0ec03b7c1341 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:44.609171 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc6f81-9309-4ad7-949e-0ec03b7c1341 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:44.609171 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc6f81-9309-4ad7-949e-0ec03b7c1341 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:44.613375 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 615/1206] 10.222.0.43 () {54 vars in 912 bytes} [Fri Aug 19 04:02:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 04:02:44.614612 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c685e-8765-4dd5-9b15-d936005a3163 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:44.614902 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c685e-8765-4dd5-9b15-d936005a3163 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:44.615172 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c685e-8765-4dd5-9b15-d936005a3163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:44.646422 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-886c685e-8765-4dd5-9b15-d936005a3163 None None] MFA Rules not processed for user `7aab3a88f9d0401db32fbaadef2711ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:02:44.647510 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-886c685e-8765-4dd5-9b15-d936005a3163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:02:44.658788 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 616/1207] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Aug 19 04:02:44 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:02:44.673085 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c685e-8765-4dd5-9b15-d936005a3163 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:44.679992 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08c95c-0f3f-4193-a360-d723933abdc8 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:44.682818 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c685e-8765-4dd5-9b15-d936005a3163 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:44.686625 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a354dd-7bcd-4836-b187-966b0f0f6d0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '366baacae7c143929a64f5b639c17a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:44.687317 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a354dd-7bcd-4836-b187-966b0f0f6d0c service placement] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:44.687457 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b3d38-ce69-40ae-bc7a-643614c50a5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:44.687710 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a354dd-7bcd-4836-b187-966b0f0f6d0c service placement] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:44.688235 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a354dd-7bcd-4836-b187-966b0f0f6d0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:44.688577 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b3d38-ce69-40ae-bc7a-643614c50a5f service neutron] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:44.689023 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b3d38-ce69-40ae-bc7a-643614c50a5f service neutron] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:44.689439 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b3d38-ce69-40ae-bc7a-643614c50a5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:44.690613 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-10a354dd-7bcd-4836-b187-966b0f0f6d0c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:02:44.700010 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b3d38-ce69-40ae-bc7a-643614c50a5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:44.701697 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b3d38-ce69-40ae-bc7a-643614c50a5f service neutron] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:44.704471 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a354dd-7bcd-4836-b187-966b0f0f6d0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:44.706507 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a354dd-7bcd-4836-b187-966b0f0f6d0c service placement] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:44.719324 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 592/1208] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:02:44 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 04:02:44.723244 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 617/1209] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:02:44 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 04:02:54.708088 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=23 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:02:54.713669 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=32 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:02:54.821115 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20661853-7758-408d-876d-b4f1b6a5832d None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:54.821548 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20661853-7758-408d-876d-b4f1b6a5832d None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:54.821770 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20661853-7758-408d-876d-b4f1b6a5832d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:54.843423 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-20661853-7758-408d-876d-b4f1b6a5832d None None] MFA Rules not processed for user `00454605826e4d6593d2d6aa331ebdc6`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:02:54.844680 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-20661853-7758-408d-876d-b4f1b6a5832d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:02:54.851794 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 593/1210] 10.222.0.15 () {58 vars in 1015 bytes} [Fri Aug 19 04:02:54 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:02:54.881432 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b3d38-ce69-40ae-bc7a-643614c50a5f service neutron] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:54.889984 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b3d38-ce69-40ae-bc7a-643614c50a5f service neutron] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:54.893936 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe922ae-e9ab-4b6b-a8a3-bd2a7a01d98e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:54.894533 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe922ae-e9ab-4b6b-a8a3-bd2a7a01d98e service neutron] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:54.894809 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe922ae-e9ab-4b6b-a8a3-bd2a7a01d98e service neutron] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:54.895079 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe922ae-e9ab-4b6b-a8a3-bd2a7a01d98e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:54.902709 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe922ae-e9ab-4b6b-a8a3-bd2a7a01d98e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:54.904145 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe922ae-e9ab-4b6b-a8a3-bd2a7a01d98e service neutron] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:54.912109 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 618/1211] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:02:54 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 04:02:55.657461 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce4281-13cc-4963-9b76-f35943de9a54 None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:55.657968 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce4281-13cc-4963-9b76-f35943de9a54 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:55.658349 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce4281-13cc-4963-9b76-f35943de9a54 None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:55.659915 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 594/1212] 10.222.0.43 () {54 vars in 921 bytes} [Fri Aug 19 04:02:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 04:02:55.697099 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f738e-3f55-4274-b4b7-c6504a413357 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:55.697388 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f738e-3f55-4274-b4b7-c6504a413357 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:55.698138 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f738e-3f55-4274-b4b7-c6504a413357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:55.726677 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-7f2f738e-3f55-4274-b4b7-c6504a413357 None None] MFA Rules not processed for user `7aab3a88f9d0401db32fbaadef2711ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:02:55.728889 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-7f2f738e-3f55-4274-b4b7-c6504a413357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:02:55.740322 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 619/1213] 10.222.0.43 () {58 vars in 1018 bytes} [Fri Aug 19 04:02:55 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 04:02:55.758537 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce4281-13cc-4963-9b76-f35943de9a54 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:02:55.774624 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce4281-13cc-4963-9b76-f35943de9a54 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:02:55.780570 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f167e98-b7c7-4bde-8144-ca8a0403fc99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:02:55.781183 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f167e98-b7c7-4bde-8144-ca8a0403fc99 service nova] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:02:55.781462 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f167e98-b7c7-4bde-8144-ca8a0403fc99 service nova] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:02:55.781733 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f167e98-b7c7-4bde-8144-ca8a0403fc99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:02:55.790894 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f167e98-b7c7-4bde-8144-ca8a0403fc99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:02:55.793107 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f167e98-b7c7-4bde-8144-ca8a0403fc99 service nova] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:02:55.803582 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 595/1214] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:02:55 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:03:02.226156 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04c740-1a01-4325-8bda-da1ca2288f39 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:03:02.226795 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04c740-1a01-4325-8bda-da1ca2288f39 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:03:02.227062 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04c740-1a01-4325-8bda-da1ca2288f39 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:03:02.228905 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 620/1215] 10.222.0.43 () {54 vars in 921 bytes} [Fri Aug 19 04:03:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 04:03:02.235907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd14ba-e43b-42e0-b320-f148407a8a37 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:03:02.236391 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd14ba-e43b-42e0-b320-f148407a8a37 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:03:02.236679 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd14ba-e43b-42e0-b320-f148407a8a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:03:02.258346 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-3edd14ba-e43b-42e0-b320-f148407a8a37 None None] MFA Rules not processed for user `7aab3a88f9d0401db32fbaadef2711ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:03:02.259671 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-3edd14ba-e43b-42e0-b320-f148407a8a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:03:02.283490 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 596/1216] 10.222.0.43 () {58 vars in 1018 bytes} [Fri Aug 19 04:03:02 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:03:02.298060 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04c740-1a01-4325-8bda-da1ca2288f39 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:03:02.314471 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04c740-1a01-4325-8bda-da1ca2288f39 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:03:02.320018 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbc420-10e6-404d-8972-f3a75464667d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:03:02.320656 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbc420-10e6-404d-8972-f3a75464667d service nova] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:03:02.320933 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbc420-10e6-404d-8972-f3a75464667d service nova] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:03:02.321206 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbc420-10e6-404d-8972-f3a75464667d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:03:02.330550 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffbc420-10e6-404d-8972-f3a75464667d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:03:02.332222 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffbc420-10e6-404d-8972-f3a75464667d service nova] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:03:02.343107 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 621/1217] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:03:02 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:03:12.253206 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=12 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:03:12.337796 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=15 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:03:13.766359 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd14ba-e43b-42e0-b320-f148407a8a37 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:03:13.775647 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd14ba-e43b-42e0-b320-f148407a8a37 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:03:13.779735 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958075e-80e4-4ad9-87ea-b9e362ec714d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:03:13.780334 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958075e-80e4-4ad9-87ea-b9e362ec714d service neutron] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:03:13.780643 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958075e-80e4-4ad9-87ea-b9e362ec714d service neutron] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:03:13.780917 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958075e-80e4-4ad9-87ea-b9e362ec714d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:03:13.789780 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958075e-80e4-4ad9-87ea-b9e362ec714d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:03:13.791896 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958075e-80e4-4ad9-87ea-b9e362ec714d service neutron] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:03:13.801884 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 597/1218] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:03:13 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:03:17.628158 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061c380-23db-42dc-b134-153ee57a39eb None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:03:17.629610 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061c380-23db-42dc-b134-153ee57a39eb None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:03:17.630103 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061c380-23db-42dc-b134-153ee57a39eb None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:03:17.631899 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 622/1219] 10.222.0.43 () {54 vars in 921 bytes} [Fri Aug 19 04:03:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 04:03:17.696745 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220f385-5d62-449f-b566-e47ace0a39fd None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:03:17.697865 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220f385-5d62-449f-b566-e47ace0a39fd None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:03:17.698306 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220f385-5d62-449f-b566-e47ace0a39fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:03:17.729937 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-1220f385-5d62-449f-b566-e47ace0a39fd None None] MFA Rules not processed for user `7aab3a88f9d0401db32fbaadef2711ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:03:17.731354 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-1220f385-5d62-449f-b566-e47ace0a39fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:03:17.743268 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 598/1220] 10.222.0.43 () {58 vars in 1018 bytes} [Fri Aug 19 04:03:17 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:03:17.760128 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061c380-23db-42dc-b134-153ee57a39eb None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:03:17.777014 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061c380-23db-42dc-b134-153ee57a39eb None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:03:17.783245 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024e72e-a8e9-474c-aae7-caaabe586739 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:03:17.784162 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024e72e-a8e9-474c-aae7-caaabe586739 service nova] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:03:17.784952 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024e72e-a8e9-474c-aae7-caaabe586739 service nova] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:03:17.785448 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024e72e-a8e9-474c-aae7-caaabe586739 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:03:17.797387 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024e72e-a8e9-474c-aae7-caaabe586739 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:03:17.799454 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024e72e-a8e9-474c-aae7-caaabe586739 service nova] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:03:17.813024 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 623/1221] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:03:17 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:03:27.724015 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=9 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:03:27.806581 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=6 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:03:31.658233 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae07a5-4f52-49fb-8f23-23221fb6d0cc None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:03:31.658849 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae07a5-4f52-49fb-8f23-23221fb6d0cc None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:03:31.658849 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae07a5-4f52-49fb-8f23-23221fb6d0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:03:31.677601 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-22ae07a5-4f52-49fb-8f23-23221fb6d0cc None None] MFA Rules not processed for user `32125988f4354e7d8559e08e445cb622`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:03:31.678787 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-22ae07a5-4f52-49fb-8f23-23221fb6d0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:03:31.686265 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 599/1222] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 04:03:31 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:03:31.995013 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80952a-f96c-44e0-b2e5-4e52dd26459f None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:03:31.995517 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80952a-f96c-44e0-b2e5-4e52dd26459f None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:03:31.995613 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80952a-f96c-44e0-b2e5-4e52dd26459f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:03:32.014408 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-fe80952a-f96c-44e0-b2e5-4e52dd26459f None None] MFA Rules not processed for user `00454605826e4d6593d2d6aa331ebdc6`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:03:32.015601 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-fe80952a-f96c-44e0-b2e5-4e52dd26459f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:03:32.021955 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 624/1223] 10.222.0.43 () {58 vars in 1009 bytes} [Fri Aug 19 04:03:31 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:03:32.033239 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae07a5-4f52-49fb-8f23-23221fb6d0cc None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:03:32.042445 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae07a5-4f52-49fb-8f23-23221fb6d0cc None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:03:32.046525 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cabad3-9655-46b3-afe6-fe8eb0eb256a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:03:32.047117 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cabad3-9655-46b3-afe6-fe8eb0eb256a service neutron] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:03:32.047397 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cabad3-9655-46b3-afe6-fe8eb0eb256a service neutron] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:03:32.047669 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cabad3-9655-46b3-afe6-fe8eb0eb256a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:03:32.054500 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cabad3-9655-46b3-afe6-fe8eb0eb256a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:03:32.055923 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cabad3-9655-46b3-afe6-fe8eb0eb256a service neutron] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:03:32.063527 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 600/1224] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:03:32 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:03:42.009735 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=3 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:03:42.060168 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=9 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:03:54.442176 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3db308-fc48-45e4-b2b3-545855bddcce None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:03:54.442649 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3db308-fc48-45e4-b2b3-545855bddcce None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:03:54.442649 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3db308-fc48-45e4-b2b3-545855bddcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:03:54.462120 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-0d3db308-fc48-45e4-b2b3-545855bddcce None None] MFA Rules not processed for user `32125988f4354e7d8559e08e445cb622`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:03:54.463309 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-0d3db308-fc48-45e4-b2b3-545855bddcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:03:54.470718 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 625/1225] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 04:03:54 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:04:04.457499 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=3 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:04:08.895683 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c73f0b-34ee-4471-b824-2e61518ca354 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:04:08.896158 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c73f0b-34ee-4471-b824-2e61518ca354 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:04:08.896261 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c73f0b-34ee-4471-b824-2e61518ca354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:04:08.915398 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-18c73f0b-34ee-4471-b824-2e61518ca354 None None] MFA Rules not processed for user `32125988f4354e7d8559e08e445cb622`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:04:08.916629 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-18c73f0b-34ee-4471-b824-2e61518ca354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:04:08.923399 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 601/1226] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 04:04:08 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:04:18.910582 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=3 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:05:04.991069 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26d953-20d2-4d7d-9a87-82142bd4fcb0 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:05:04.991516 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26d953-20d2-4d7d-9a87-82142bd4fcb0 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:05:04.991627 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26d953-20d2-4d7d-9a87-82142bd4fcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:05:05.010039 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-af26d953-20d2-4d7d-9a87-82142bd4fcb0 None None] MFA Rules not processed for user `32125988f4354e7d8559e08e445cb622`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:05:05.011247 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-af26d953-20d2-4d7d-9a87-82142bd4fcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:05:05.018076 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 626/1227] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 04:05:04 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:05:15.004975 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=3 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:05:16.698872 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c73f0b-34ee-4471-b824-2e61518ca354 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:05:16.717329 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c73f0b-34ee-4471-b824-2e61518ca354 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:05:16.720873 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ffb84-0592-4ed4-806a-5aa5be655684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:05:16.721470 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ffb84-0592-4ed4-806a-5aa5be655684 service neutron] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:05:16.721750 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ffb84-0592-4ed4-806a-5aa5be655684 service neutron] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:05:16.722026 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ffb84-0592-4ed4-806a-5aa5be655684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:05:16.731345 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ffb84-0592-4ed4-806a-5aa5be655684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:05:16.732798 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ffb84-0592-4ed4-806a-5aa5be655684 service neutron] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:05:16.742966 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 602/1228] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:05:16 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:05:26.738184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=10 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:05:50.375442 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26d953-20d2-4d7d-9a87-82142bd4fcb0 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:05:50.398192 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26d953-20d2-4d7d-9a87-82142bd4fcb0 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:05:50.404562 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c9b71-e825-465b-8912-2f02a761ada9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '366baacae7c143929a64f5b639c17a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:05:50.405159 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c9b71-e825-465b-8912-2f02a761ada9 service placement] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:05:50.405437 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c9b71-e825-465b-8912-2f02a761ada9 service placement] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:05:50.405758 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c9b71-e825-465b-8912-2f02a761ada9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:05:50.414366 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c9b71-e825-465b-8912-2f02a761ada9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:05:50.415957 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c9b71-e825-465b-8912-2f02a761ada9 service placement] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:05:50.427138 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 627/1229] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:05:50 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:06:00.422746 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=10 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:07:06.486607 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaae14f-ef5d-41d5-b5cf-72fb439c6f76 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:07:06.487165 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaae14f-ef5d-41d5-b5cf-72fb439c6f76 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:07:06.487165 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaae14f-ef5d-41d5-b5cf-72fb439c6f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:07:06.506274 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-eeaae14f-ef5d-41d5-b5cf-72fb439c6f76 None None] MFA Rules not processed for user `1419252d53a3455f982ad2aafa3624a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:07:06.507446 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-eeaae14f-ef5d-41d5-b5cf-72fb439c6f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:07:06.514181 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 603/1230] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 04:07:06 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:07:16.500858 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=3 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:07:28.761879 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591973e-64a4-4c0c-8843-20758218d8f8 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:07:28.762413 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591973e-64a4-4c0c-8843-20758218d8f8 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:07:28.762618 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591973e-64a4-4c0c-8843-20758218d8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:07:28.783379 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-0591973e-64a4-4c0c-8843-20758218d8f8 None None] MFA Rules not processed for user `32125988f4354e7d8559e08e445cb622`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:07:28.784635 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-0591973e-64a4-4c0c-8843-20758218d8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:07:28.793846 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 628/1231] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 04:07:28 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:07:33.779019 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaae14f-ef5d-41d5-b5cf-72fb439c6f76 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:07:33.789117 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaae14f-ef5d-41d5-b5cf-72fb439c6f76 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:07:33.792913 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d40f6-b726-402d-a373-8603d02bd60d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:07:33.793513 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d40f6-b726-402d-a373-8603d02bd60d service neutron] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:07:33.793785 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d40f6-b726-402d-a373-8603d02bd60d service neutron] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:07:33.794055 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d40f6-b726-402d-a373-8603d02bd60d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:07:33.802692 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d40f6-b726-402d-a373-8603d02bd60d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:07:33.804117 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d40f6-b726-402d-a373-8603d02bd60d service neutron] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:07:33.812901 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 604/1232] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:07:33 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 04:07:35.840687 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591973e-64a4-4c0c-8843-20758218d8f8 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:07:35.862193 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591973e-64a4-4c0c-8843-20758218d8f8 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:07:35.868694 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184573ca-00e1-46cb-8b41-c5d51a11446f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:07:35.869304 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184573ca-00e1-46cb-8b41-c5d51a11446f service nova] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:07:35.869580 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184573ca-00e1-46cb-8b41-c5d51a11446f service nova] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:07:35.869848 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184573ca-00e1-46cb-8b41-c5d51a11446f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:07:35.878094 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184573ca-00e1-46cb-8b41-c5d51a11446f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:07:35.880615 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184573ca-00e1-46cb-8b41-c5d51a11446f service nova] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:07:35.889587 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 629/1233] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:07:35 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:07:43.808862 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=6 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:07:45.885540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=13 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:08:00.185953 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d40f6-b726-402d-a373-8603d02bd60d service neutron] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:08:00.195196 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d40f6-b726-402d-a373-8603d02bd60d service neutron] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:08:00.199858 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13acb7-8524-4e0e-811e-b3e7c71e3127 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:08:00.200573 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13acb7-8524-4e0e-811e-b3e7c71e3127 service neutron] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:08:00.200853 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13acb7-8524-4e0e-811e-b3e7c71e3127 service neutron] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:08:00.201566 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13acb7-8524-4e0e-811e-b3e7c71e3127 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:08:00.202594 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184573ca-00e1-46cb-8b41-c5d51a11446f service nova] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:08:00.212064 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184573ca-00e1-46cb-8b41-c5d51a11446f service nova] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:08:00.213120 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13acb7-8524-4e0e-811e-b3e7c71e3127 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:08:00.214662 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13acb7-8524-4e0e-811e-b3e7c71e3127 service neutron] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:08:00.215638 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e8b7b-bfe6-48e9-8858-59d8b1a12205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:08:00.216225 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e8b7b-bfe6-48e9-8858-59d8b1a12205 service neutron] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:08:00.216524 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e8b7b-bfe6-48e9-8858-59d8b1a12205 service neutron] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:08:00.216812 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e8b7b-bfe6-48e9-8858-59d8b1a12205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:08:00.224520 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e8b7b-bfe6-48e9-8858-59d8b1a12205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:08:00.226537 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e8b7b-bfe6-48e9-8858-59d8b1a12205 service neutron] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:08:00.226737 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 605/1234] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:08:00 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:08:00.235082 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 630/1235] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:08:00 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 04:08:01.540070 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13acb7-8524-4e0e-811e-b3e7c71e3127 service neutron] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:08:01.548704 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13acb7-8524-4e0e-811e-b3e7c71e3127 service neutron] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:08:01.552274 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ecd7d-512c-4392-aa59-104804a24d70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:08:01.552907 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ecd7d-512c-4392-aa59-104804a24d70 service neutron] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:08:01.553184 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ecd7d-512c-4392-aa59-104804a24d70 service neutron] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:08:01.553458 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ecd7d-512c-4392-aa59-104804a24d70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:08:01.563568 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ecd7d-512c-4392-aa59-104804a24d70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:08:01.565074 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ecd7d-512c-4392-aa59-104804a24d70 service neutron] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:08:01.575064 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 606/1236] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:08:01 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:08:10.231582 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=6 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:08:11.570681 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=12 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:08:45.590435 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e8b7b-bfe6-48e9-8858-59d8b1a12205 service neutron] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:08:45.613632 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e8b7b-bfe6-48e9-8858-59d8b1a12205 service neutron] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:08:45.623037 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e115a3-87e2-4ad2-99a5-c477e8ed3ed0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:08:45.624204 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e115a3-87e2-4ad2-99a5-c477e8ed3ed0 service nova] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:08:45.625312 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e115a3-87e2-4ad2-99a5-c477e8ed3ed0 service nova] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:08:45.625919 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e115a3-87e2-4ad2-99a5-c477e8ed3ed0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:08:45.639874 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e115a3-87e2-4ad2-99a5-c477e8ed3ed0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:08:45.641883 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e115a3-87e2-4ad2-99a5-c477e8ed3ed0 service nova] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:08:45.658363 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 631/1237] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:08:45 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:08:46.717557 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ecd7d-512c-4392-aa59-104804a24d70 service neutron] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:08:46.734022 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ecd7d-512c-4392-aa59-104804a24d70 service neutron] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:08:46.741042 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc657c2b-811a-4e1d-b3fb-80c0911c3587 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:08:46.741918 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc657c2b-811a-4e1d-b3fb-80c0911c3587 service nova] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:08:46.742240 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc657c2b-811a-4e1d-b3fb-80c0911c3587 service nova] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:08:46.742738 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc657c2b-811a-4e1d-b3fb-80c0911c3587 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:08:46.752546 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc657c2b-811a-4e1d-b3fb-80c0911c3587 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:08:46.754336 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc657c2b-811a-4e1d-b3fb-80c0911c3587 service nova] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:08:46.765349 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 607/1238] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:08:46 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:08:53.497615 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e115a3-87e2-4ad2-99a5-c477e8ed3ed0 service nova] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:08:53.507109 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e115a3-87e2-4ad2-99a5-c477e8ed3ed0 service nova] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:08:53.510624 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5d0f2-e097-4edc-bc5e-19eac03d5c95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:08:53.511207 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5d0f2-e097-4edc-bc5e-19eac03d5c95 service neutron] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:08:53.511480 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5d0f2-e097-4edc-bc5e-19eac03d5c95 service neutron] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:08:53.511747 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5d0f2-e097-4edc-bc5e-19eac03d5c95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:08:53.569662 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5d0f2-e097-4edc-bc5e-19eac03d5c95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:08:53.571088 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5d0f2-e097-4edc-bc5e-19eac03d5c95 service neutron] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:08:53.589248 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 632/1239] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:08:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:08:56.737407 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c9935-a060-4050-95ba-0274c0d97edc None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:08:56.737985 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c9935-a060-4050-95ba-0274c0d97edc None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:08:56.738127 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c9935-a060-4050-95ba-0274c0d97edc None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:08:56.739473 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 608/1240] 10.222.0.43 () {54 vars in 921 bytes} [Fri Aug 19 04:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 04:08:56.760741 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=6 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:08:56.764633 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772adf1f-783b-4875-aae8-65ee79c10941 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:08:56.765110 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772adf1f-783b-4875-aae8-65ee79c10941 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:08:56.765350 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772adf1f-783b-4875-aae8-65ee79c10941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:08:56.838537 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-772adf1f-783b-4875-aae8-65ee79c10941 None None] MFA Rules not processed for user `366baacae7c143929a64f5b639c17a99`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:08:56.839758 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-772adf1f-783b-4875-aae8-65ee79c10941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:08:56.848188 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 633/1241] 10.222.0.43 () {58 vars in 1018 bytes} [Fri Aug 19 04:08:56 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:08:56.860603 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119c067-dc66-4cab-afee-6364a3fb4a4a None None] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:08:56.860878 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119c067-dc66-4cab-afee-6364a3fb4a4a None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:08:56.861235 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119c067-dc66-4cab-afee-6364a3fb4a4a None None] PATH_INFO: `/` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:08:56.862708 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 609/1242] 10.222.0.43 () {54 vars in 961 bytes} [Fri Aug 19 04:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 04:08:56.867879 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea4364-4cda-4e42-aaa6-e3deb56ac021 None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:08:56.868192 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea4364-4cda-4e42-aaa6-e3deb56ac021 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:08:56.868471 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea4364-4cda-4e42-aaa6-e3deb56ac021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:08:56.888438 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-aeea4364-4cda-4e42-aaa6-e3deb56ac021 None None] MFA Rules not processed for user `366baacae7c143929a64f5b639c17a99`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:08:56.889683 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-aeea4364-4cda-4e42-aaa6-e3deb56ac021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:08:56.899415 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 634/1243] 10.222.0.43 () {58 vars in 1058 bytes} [Fri Aug 19 04:08:56 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 04:08:56.907243 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119c067-dc66-4cab-afee-6364a3fb4a4a None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:08:56.921624 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119c067-dc66-4cab-afee-6364a3fb4a4a None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:08:56.926825 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4fe15-7459-49bf-a67d-7402b1c434e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '366baacae7c143929a64f5b639c17a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:08:56.927424 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4fe15-7459-49bf-a67d-7402b1c434e3 service placement] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:08:56.927706 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4fe15-7459-49bf-a67d-7402b1c434e3 service placement] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:08:56.927981 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4fe15-7459-49bf-a67d-7402b1c434e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:08:56.936918 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4fe15-7459-49bf-a67d-7402b1c434e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:08:56.938497 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4fe15-7459-49bf-a67d-7402b1c434e3 service placement] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:08:56.951985 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 610/1244] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:08:56 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 04:09:00.301218 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea4364-4cda-4e42-aaa6-e3deb56ac021 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:09:00.312238 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea4364-4cda-4e42-aaa6-e3deb56ac021 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:09:00.316793 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e52029-0ce9-4b0a-bd3a-b22bc99d6e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:09:00.317414 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e52029-0ce9-4b0a-bd3a-b22bc99d6e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:09:00.317687 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e52029-0ce9-4b0a-bd3a-b22bc99d6e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:09:00.317954 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e52029-0ce9-4b0a-bd3a-b22bc99d6e6a admin admin] PATH_INFO: `/v3/users/1419252d53a3455f982ad2aafa3624a7` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:09:00.319060 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e52029-0ce9-4b0a-bd3a-b22bc99d6e6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1419252d53a3455f982ad2aafa3624a7)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:09:00.321008 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e52029-0ce9-4b0a-bd3a-b22bc99d6e6a admin admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:09:00.370401 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [None req-58e52029-0ce9-4b0a-bd3a-b22bc99d6e6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1419252d53a3455f982ad2aafa3624a7'} {{(pid=88197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:09:00.379013 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [None req-58e52029-0ce9-4b0a-bd3a-b22bc99d6e6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1419252d53a3455f982ad2aafa3624a7'} {{(pid=88197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:09:00.392176 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [None req-58e52029-0ce9-4b0a-bd3a-b22bc99d6e6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1419252d53a3455f982ad2aafa3624a7'} {{(pid=88197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:09:00.399034 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [None req-58e52029-0ce9-4b0a-bd3a-b22bc99d6e6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1419252d53a3455f982ad2aafa3624a7'} {{(pid=88197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:09:00.399760 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [None req-58e52029-0ce9-4b0a-bd3a-b22bc99d6e6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1419252d53a3455f982ad2aafa3624a7'} {{(pid=88197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:09:00.401186 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:09:00.406576 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 635/1245] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 04:09:00 2022] DELETE /identity/v3/users/1419252d53a3455f982ad2aafa3624a7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 04:09:00.790159 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4fe15-7459-49bf-a67d-7402b1c434e3 service placement] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:09:00.804251 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4fe15-7459-49bf-a67d-7402b1c434e3 service placement] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:09:00.860196 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9d210-c71c-474b-b5ce-c7cc8ebf0e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:09:00.860845 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9d210-c71c-474b-b5ce-c7cc8ebf0e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:09:00.861120 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9d210-c71c-474b-b5ce-c7cc8ebf0e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:09:00.861387 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9d210-c71c-474b-b5ce-c7cc8ebf0e80 admin admin] PATH_INFO: `/v3/projects/6a3e3e3893104e46bf3bf7952f4857fa` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:09:00.862475 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9d210-c71c-474b-b5ce-c7cc8ebf0e80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a3e3e3893104e46bf3bf7952f4857fa)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:09:00.864371 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9d210-c71c-474b-b5ce-c7cc8ebf0e80 admin admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:09:00.908390 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [None req-96c9d210-c71c-474b-b5ce-c7cc8ebf0e80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a3e3e3893104e46bf3bf7952f4857fa', 'request_id': 'req-96c9d210-c71c-474b-b5ce-c7cc8ebf0e80'} {{(pid=88198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:09:00.914304 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [None req-96c9d210-c71c-474b-b5ce-c7cc8ebf0e80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a3e3e3893104e46bf3bf7952f4857fa', 'request_id': 'req-96c9d210-c71c-474b-b5ce-c7cc8ebf0e80'} {{(pid=88198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:09:00.921759 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [None req-96c9d210-c71c-474b-b5ce-c7cc8ebf0e80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a3e3e3893104e46bf3bf7952f4857fa', 'request_id': 'req-96c9d210-c71c-474b-b5ce-c7cc8ebf0e80'} {{(pid=88198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:09:00.932008 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [None req-96c9d210-c71c-474b-b5ce-c7cc8ebf0e80 admin admin] The token cache is being invalidate because project 6a3e3e3893104e46bf3bf7952f4857fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 04:09:00.932300 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [None req-96c9d210-c71c-474b-b5ce-c7cc8ebf0e80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:09:00.932966 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [None req-96c9d210-c71c-474b-b5ce-c7cc8ebf0e80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:09:00.934465 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 611/1246] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 04:09:00 2022] DELETE /identity/v3/projects/6a3e3e3893104e46bf3bf7952f4857fa => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 04:09:00.938579 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e52029-0ce9-4b0a-bd3a-b22bc99d6e6a admin admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:09:00.940004 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-58e52029-0ce9-4b0a-bd3a-b22bc99d6e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:09:00.952837 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e52029-0ce9-4b0a-bd3a-b22bc99d6e6a admin admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:09:01.009841 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f38e50-7a42-4139-bf4a-681f2052a944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:09:01.010386 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f38e50-7a42-4139-bf4a-681f2052a944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:09:01.010666 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f38e50-7a42-4139-bf4a-681f2052a944 admin admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:09:01.010940 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f38e50-7a42-4139-bf4a-681f2052a944 admin admin] PATH_INFO: `/v3/users/95337b59e45f407c977d795e1281623b` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:09:01.012048 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f38e50-7a42-4139-bf4a-681f2052a944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95337b59e45f407c977d795e1281623b)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:09:01.014002 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f38e50-7a42-4139-bf4a-681f2052a944 admin admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:09:01.059088 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [None req-77f38e50-7a42-4139-bf4a-681f2052a944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95337b59e45f407c977d795e1281623b'} {{(pid=88197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:09:01.065791 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [None req-77f38e50-7a42-4139-bf4a-681f2052a944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95337b59e45f407c977d795e1281623b'} {{(pid=88197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:09:01.077549 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [None req-77f38e50-7a42-4139-bf4a-681f2052a944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95337b59e45f407c977d795e1281623b'} {{(pid=88197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:09:01.084270 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [None req-77f38e50-7a42-4139-bf4a-681f2052a944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95337b59e45f407c977d795e1281623b'} {{(pid=88197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:09:01.084995 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [None req-77f38e50-7a42-4139-bf4a-681f2052a944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95337b59e45f407c977d795e1281623b'} {{(pid=88197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:09:01.090625 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 636/1247] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 04:09:00 2022] DELETE /identity/v3/users/95337b59e45f407c977d795e1281623b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 04:09:01.260359 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9d210-c71c-474b-b5ce-c7cc8ebf0e80 admin admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:09:01.261811 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-96c9d210-c71c-474b-b5ce-c7cc8ebf0e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:09:01.275014 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9d210-c71c-474b-b5ce-c7cc8ebf0e80 admin admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:09:01.331008 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48492b2e-c8bd-43b6-add4-f0b5080784f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:09:01.331646 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48492b2e-c8bd-43b6-add4-f0b5080784f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:09:01.331926 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48492b2e-c8bd-43b6-add4-f0b5080784f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:09:01.332225 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48492b2e-c8bd-43b6-add4-f0b5080784f7 admin admin] PATH_INFO: `/v3/projects/e1e59139f59040d39a5d73080f22a27e` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:09:01.333380 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48492b2e-c8bd-43b6-add4-f0b5080784f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1e59139f59040d39a5d73080f22a27e)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:09:01.335301 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48492b2e-c8bd-43b6-add4-f0b5080784f7 admin admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:09:01.357196 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:09:01.384168 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [None req-48492b2e-c8bd-43b6-add4-f0b5080784f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1e59139f59040d39a5d73080f22a27e', 'request_id': 'req-48492b2e-c8bd-43b6-add4-f0b5080784f7'} {{(pid=88198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:09:01.391061 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [None req-48492b2e-c8bd-43b6-add4-f0b5080784f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1e59139f59040d39a5d73080f22a27e', 'request_id': 'req-48492b2e-c8bd-43b6-add4-f0b5080784f7'} {{(pid=88198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:09:01.398983 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [None req-48492b2e-c8bd-43b6-add4-f0b5080784f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1e59139f59040d39a5d73080f22a27e', 'request_id': 'req-48492b2e-c8bd-43b6-add4-f0b5080784f7'} {{(pid=88198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:09:01.409970 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [None req-48492b2e-c8bd-43b6-add4-f0b5080784f7 admin admin] The token cache is being invalidate because project e1e59139f59040d39a5d73080f22a27e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 04:09:01.410257 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [None req-48492b2e-c8bd-43b6-add4-f0b5080784f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:09:01.410878 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [None req-48492b2e-c8bd-43b6-add4-f0b5080784f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:09:01.412537 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 612/1248] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 04:09:01 2022] DELETE /identity/v3/projects/e1e59139f59040d39a5d73080f22a27e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 04:09:11.087299 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:09:11.406736 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:09:31.516546 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf65406-2652-440d-9902-6cce2b1fcf0d None None] REQUEST_METHOD: `POST` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:09:31.517080 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf65406-2652-440d-9902-6cce2b1fcf0d None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:09:31.517080 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf65406-2652-440d-9902-6cce2b1fcf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:09:31.535693 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.auth.core [None req-fbf65406-2652-440d-9902-6cce2b1fcf0d None None] MFA Rules not processed for user `32125988f4354e7d8559e08e445cb622`. Rule list: `[]` (Enabled: `True`). {{(pid=88197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:09:31.536940 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-fbf65406-2652-440d-9902-6cce2b1fcf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:09:31.590792 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 637/1249] 10.222.0.43 () {58 vars in 958 bytes} [Fri Aug 19 04:09:31 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:09:32.099334 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48492b2e-c8bd-43b6-add4-f0b5080784f7 admin admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:09:32.100794 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-48492b2e-c8bd-43b6-add4-f0b5080784f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:09:32.157308 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48492b2e-c8bd-43b6-add4-f0b5080784f7 admin admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:09:32.161196 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298e30c-da73-466a-ba01-f1c9fe8ba431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:09:32.161815 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298e30c-da73-466a-ba01-f1c9fe8ba431 service neutron] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:09:32.162097 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298e30c-da73-466a-ba01-f1c9fe8ba431 service neutron] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:09:32.162373 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298e30c-da73-466a-ba01-f1c9fe8ba431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:09:32.164277 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-3298e30c-da73-466a-ba01-f1c9fe8ba431 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:09:32.175106 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298e30c-da73-466a-ba01-f1c9fe8ba431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:09:32.176712 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298e30c-da73-466a-ba01-f1c9fe8ba431 service neutron] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:09:32.184637 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 613/1250] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:09:32 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:09:32.614510 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf65406-2652-440d-9902-6cce2b1fcf0d None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:09:32.615979 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-fbf65406-2652-440d-9902-6cce2b1fcf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:09:32.686068 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf65406-2652-440d-9902-6cce2b1fcf0d None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:09:32.691565 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa04e68-9d5f-4bc7-814d-a063f5b30b0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '366baacae7c143929a64f5b639c17a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:09:32.692155 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa04e68-9d5f-4bc7-814d-a063f5b30b0e service placement] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:09:32.692427 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa04e68-9d5f-4bc7-814d-a063f5b30b0e service placement] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:09:32.692726 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa04e68-9d5f-4bc7-814d-a063f5b30b0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:09:32.694416 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-6fa04e68-9d5f-4bc7-814d-a063f5b30b0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:09:32.705155 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa04e68-9d5f-4bc7-814d-a063f5b30b0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:09:32.706755 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa04e68-9d5f-4bc7-814d-a063f5b30b0e service placement] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:09:32.716098 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 638/1251] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:09:32 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 04:09:40.099764 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298e30c-da73-466a-ba01-f1c9fe8ba431 service neutron] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:09:40.101356 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-3298e30c-da73-466a-ba01-f1c9fe8ba431 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:09:40.174783 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298e30c-da73-466a-ba01-f1c9fe8ba431 service neutron] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:09:40.179809 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bef49d-d316-48e4-af65-d3e9226e7efb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aab3a88f9d0401db32fbaadef2711ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:09:40.180422 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bef49d-d316-48e4-af65-d3e9226e7efb service nova] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:09:40.180732 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bef49d-d316-48e4-af65-d3e9226e7efb service nova] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:09:40.181010 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bef49d-d316-48e4-af65-d3e9226e7efb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:09:40.182750 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-b0bef49d-d316-48e4-af65-d3e9226e7efb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:09:40.194935 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bef49d-d316-48e4-af65-d3e9226e7efb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:09:40.196467 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bef49d-d316-48e4-af65-d3e9226e7efb service nova] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:09:40.206437 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 614/1252] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:09:40 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:09:42.712249 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=57 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:09:50.202396 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=58 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:10:52.348471 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa04e68-9d5f-4bc7-814d-a063f5b30b0e service placement] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:10:52.349888 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-6fa04e68-9d5f-4bc7-814d-a063f5b30b0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:10:52.411424 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa04e68-9d5f-4bc7-814d-a063f5b30b0e service placement] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:10:52.416437 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84bbf3-563b-4174-ba82-5640acacc289 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '366baacae7c143929a64f5b639c17a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:10:52.417053 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84bbf3-563b-4174-ba82-5640acacc289 service placement] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:10:52.417325 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84bbf3-563b-4174-ba82-5640acacc289 service placement] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:10:52.417600 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84bbf3-563b-4174-ba82-5640acacc289 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:10:52.419253 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-fb84bbf3-563b-4174-ba82-5640acacc289 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:10:52.430697 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84bbf3-563b-4174-ba82-5640acacc289 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:10:52.432189 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84bbf3-563b-4174-ba82-5640acacc289 service placement] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:10:52.442630 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 639/1253] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:10:52 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:11:02.437657 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=28 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:12:21.145119 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bef49d-d316-48e4-af65-d3e9226e7efb service nova] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:12:21.146524 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-b0bef49d-d316-48e4-af65-d3e9226e7efb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:12:21.193162 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bef49d-d316-48e4-af65-d3e9226e7efb service nova] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:12:21.196781 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9a0f5-7ccb-4801-8dfd-dd09ef76c73c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00454605826e4d6593d2d6aa331ebdc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:12:21.197385 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9a0f5-7ccb-4801-8dfd-dd09ef76c73c service neutron] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:12:21.197665 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9a0f5-7ccb-4801-8dfd-dd09ef76c73c service neutron] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:12:21.197942 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9a0f5-7ccb-4801-8dfd-dd09ef76c73c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:12:21.199635 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-fcd9a0f5-7ccb-4801-8dfd-dd09ef76c73c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:12:21.280466 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9a0f5-7ccb-4801-8dfd-dd09ef76c73c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:12:21.281920 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9a0f5-7ccb-4801-8dfd-dd09ef76c73c service neutron] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:12:21.291668 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 615/1254] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:12:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:12:24.342712 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01b1c0-1cdc-435d-810d-9c99c8d65bc4 None None] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:12:24.343273 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01b1c0-1cdc-435d-810d-9c99c8d65bc4 None None] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:12:24.343273 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01b1c0-1cdc-435d-810d-9c99c8d65bc4 None None] PATH_INFO: `/` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:12:24.344843 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 640/1255] 10.222.0.43 () {54 vars in 921 bytes} [Fri Aug 19 04:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 04:12:24.378545 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9434545-bedd-4e10-a8e6-422b32dea500 None None] REQUEST_METHOD: `POST` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:12:24.379093 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9434545-bedd-4e10-a8e6-422b32dea500 None None] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:12:24.379481 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9434545-bedd-4e10-a8e6-422b32dea500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:12:24.415962 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.auth.core [None req-a9434545-bedd-4e10-a8e6-422b32dea500 None None] MFA Rules not processed for user `366baacae7c143929a64f5b639c17a99`. Rule list: `[]` (Enabled: `True`). {{(pid=88198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 04:12:24.417217 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-a9434545-bedd-4e10-a8e6-422b32dea500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:12:24.426438 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 616/1256] 10.222.0.43 () {58 vars in 1018 bytes} [Fri Aug 19 04:12:24 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 04:12:24.439515 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01b1c0-1cdc-435d-810d-9c99c8d65bc4 None None] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:12:24.453846 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01b1c0-1cdc-435d-810d-9c99c8d65bc4 None None] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:12:24.458838 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371bd12c-3a7d-4388-9faf-9269dbdb2d24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '366baacae7c143929a64f5b639c17a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:12:24.459441 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bd12c-3a7d-4388-9faf-9269dbdb2d24 service placement] REQUEST_METHOD: `GET` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:12:24.459716 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bd12c-3a7d-4388-9faf-9269dbdb2d24 service placement] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:12:24.459988 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bd12c-3a7d-4388-9faf-9269dbdb2d24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:12:24.468540 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371bd12c-3a7d-4388-9faf-9269dbdb2d24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:12:24.470152 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371bd12c-3a7d-4388-9faf-9269dbdb2d24 service placement] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:12:24.480218 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 641/1257] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:12:24 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:12:27.439653 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9434545-bedd-4e10-a8e6-422b32dea500 None None] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:12:27.442104 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-a9434545-bedd-4e10-a8e6-422b32dea500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:12:27.459341 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9434545-bedd-4e10-a8e6-422b32dea500 None None] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:12:27.464454 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f09e1-9608-4eee-b1e2-9e6d8a7e5989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:12:27.465113 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f09e1-9608-4eee-b1e2-9e6d8a7e5989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:12:27.465566 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f09e1-9608-4eee-b1e2-9e6d8a7e5989 admin admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:12:27.465843 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f09e1-9608-4eee-b1e2-9e6d8a7e5989 admin admin] PATH_INFO: `/v3/users/32125988f4354e7d8559e08e445cb622` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:12:27.481378 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f09e1-9608-4eee-b1e2-9e6d8a7e5989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32125988f4354e7d8559e08e445cb622)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:12:27.483030 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: WARNING py.warnings [None req-7c6f09e1-9608-4eee-b1e2-9e6d8a7e5989 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 04:12:27.483030 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: warnings.warn(msg) Aug 19 04:12:27.483030 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: Aug 19 04:12:27.484367 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f09e1-9608-4eee-b1e2-9e6d8a7e5989 admin admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:12:27.553084 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [None req-7c6f09e1-9608-4eee-b1e2-9e6d8a7e5989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32125988f4354e7d8559e08e445cb622'} {{(pid=88198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:12:27.571846 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [None req-7c6f09e1-9608-4eee-b1e2-9e6d8a7e5989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32125988f4354e7d8559e08e445cb622'} {{(pid=88198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:12:27.581706 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [None req-7c6f09e1-9608-4eee-b1e2-9e6d8a7e5989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32125988f4354e7d8559e08e445cb622'} {{(pid=88198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:12:27.582408 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [None req-7c6f09e1-9608-4eee-b1e2-9e6d8a7e5989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32125988f4354e7d8559e08e445cb622'} {{(pid=88198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:12:27.584042 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:12:27.590983 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [None req-7c6f09e1-9608-4eee-b1e2-9e6d8a7e5989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32125988f4354e7d8559e08e445cb622'} {{(pid=88198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:12:27.597064 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 617/1258] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 04:12:27 2022] DELETE /identity/v3/users/32125988f4354e7d8559e08e445cb622 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 04:12:27.776355 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371bd12c-3a7d-4388-9faf-9269dbdb2d24 service placement] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:12:27.789200 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371bd12c-3a7d-4388-9faf-9269dbdb2d24 service placement] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:12:27.848278 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdeb0b3-ee1c-4a06-b74d-74876da143c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:12:27.848935 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeb0b3-ee1c-4a06-b74d-74876da143c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:12:27.849214 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeb0b3-ee1c-4a06-b74d-74876da143c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:12:27.849490 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeb0b3-ee1c-4a06-b74d-74876da143c1 admin admin] PATH_INFO: `/v3/projects/416df27f835549a7bb62de5ce68fcb75` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:12:27.860096 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdeb0b3-ee1c-4a06-b74d-74876da143c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=416df27f835549a7bb62de5ce68fcb75)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:12:27.861188 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: WARNING py.warnings [None req-8bdeb0b3-ee1c-4a06-b74d-74876da143c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 04:12:27.861188 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: warnings.warn(msg) Aug 19 04:12:27.861188 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: Aug 19 04:12:27.862381 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdeb0b3-ee1c-4a06-b74d-74876da143c1 admin admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:12:27.914943 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [None req-8bdeb0b3-ee1c-4a06-b74d-74876da143c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '416df27f835549a7bb62de5ce68fcb75', 'request_id': 'req-8bdeb0b3-ee1c-4a06-b74d-74876da143c1'} {{(pid=88197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:12:27.920838 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [None req-8bdeb0b3-ee1c-4a06-b74d-74876da143c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '416df27f835549a7bb62de5ce68fcb75', 'request_id': 'req-8bdeb0b3-ee1c-4a06-b74d-74876da143c1'} {{(pid=88197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:12:27.933621 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [None req-8bdeb0b3-ee1c-4a06-b74d-74876da143c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '416df27f835549a7bb62de5ce68fcb75', 'request_id': 'req-8bdeb0b3-ee1c-4a06-b74d-74876da143c1'} {{(pid=88197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:12:27.946126 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [None req-8bdeb0b3-ee1c-4a06-b74d-74876da143c1 admin admin] The token cache is being invalidate because project 416df27f835549a7bb62de5ce68fcb75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 04:12:27.946413 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [None req-8bdeb0b3-ee1c-4a06-b74d-74876da143c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:12:27.947059 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [None req-8bdeb0b3-ee1c-4a06-b74d-74876da143c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:12:27.948816 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 642/1259] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 04:12:27 2022] DELETE /identity/v3/projects/416df27f835549a7bb62de5ce68fcb75 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 04:12:27.952957 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f09e1-9608-4eee-b1e2-9e6d8a7e5989 admin admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:12:27.954401 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-7c6f09e1-9608-4eee-b1e2-9e6d8a7e5989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:12:27.967900 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f09e1-9608-4eee-b1e2-9e6d8a7e5989 admin admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:12:28.024834 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00102b-8d53-421d-a49e-b4fc051775ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:12:28.025433 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00102b-8d53-421d-a49e-b4fc051775ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:12:28.025713 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00102b-8d53-421d-a49e-b4fc051775ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:12:28.026005 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00102b-8d53-421d-a49e-b4fc051775ec admin admin] PATH_INFO: `/v3/users/d39243349b404b7ba85383caca3f6070` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:12:28.027193 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00102b-8d53-421d-a49e-b4fc051775ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=d39243349b404b7ba85383caca3f6070)` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:12:28.029157 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00102b-8d53-421d-a49e-b4fc051775ec admin admin] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:12:28.074309 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [None req-dc00102b-8d53-421d-a49e-b4fc051775ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd39243349b404b7ba85383caca3f6070'} {{(pid=88198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:12:28.086360 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [None req-dc00102b-8d53-421d-a49e-b4fc051775ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd39243349b404b7ba85383caca3f6070'} {{(pid=88198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:12:28.093138 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [None req-dc00102b-8d53-421d-a49e-b4fc051775ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd39243349b404b7ba85383caca3f6070'} {{(pid=88198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:12:28.093794 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [None req-dc00102b-8d53-421d-a49e-b4fc051775ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd39243349b404b7ba85383caca3f6070'} {{(pid=88198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:12:28.100415 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.notifications [None req-dc00102b-8d53-421d-a49e-b4fc051775ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd39243349b404b7ba85383caca3f6070'} {{(pid=88198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:12:28.106266 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 618/1260] 10.222.0.43 () {58 vars in 1224 bytes} [Fri Aug 19 04:12:27 2022] DELETE /identity/v3/users/d39243349b404b7ba85383caca3f6070 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 04:12:28.277391 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdeb0b3-ee1c-4a06-b74d-74876da143c1 admin admin] Authenticating user token {{(pid=88197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:12:28.278854 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.fernet_utils [None req-8bdeb0b3-ee1c-4a06-b74d-74876da143c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:12:28.291658 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdeb0b3-ee1c-4a06-b74d-74876da143c1 admin admin] Validating token access rules against request {{(pid=88197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:12:28.347143 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361a831-b8ab-4942-9e73-0ce0173d5bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3297fc4b647c4c1aa4dde010a58c50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a24eb901d34f7180f97d4cbef6abef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:12:28.347794 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361a831-b8ab-4942-9e73-0ce0173d5bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:12:28.348068 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361a831-b8ab-4942-9e73-0ce0173d5bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:12:28.348340 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361a831-b8ab-4942-9e73-0ce0173d5bc8 admin admin] PATH_INFO: `/v3/projects/3b7f1342961b4dba998564d8c1f94354` {{(pid=88197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:12:28.359081 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361a831-b8ab-4942-9e73-0ce0173d5bc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b7f1342961b4dba998564d8c1f94354)` {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:12:28.361013 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361a831-b8ab-4942-9e73-0ce0173d5bc8 admin admin] RBAC: Authorization granted {{(pid=88197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:12:28.362363 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:12:28.408507 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [None req-7361a831-b8ab-4942-9e73-0ce0173d5bc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b7f1342961b4dba998564d8c1f94354', 'request_id': 'req-7361a831-b8ab-4942-9e73-0ce0173d5bc8'} {{(pid=88197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:12:28.413985 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [None req-7361a831-b8ab-4942-9e73-0ce0173d5bc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b7f1342961b4dba998564d8c1f94354', 'request_id': 'req-7361a831-b8ab-4942-9e73-0ce0173d5bc8'} {{(pid=88197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:12:28.419945 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [None req-7361a831-b8ab-4942-9e73-0ce0173d5bc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b7f1342961b4dba998564d8c1f94354', 'request_id': 'req-7361a831-b8ab-4942-9e73-0ce0173d5bc8'} {{(pid=88197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:12:28.431438 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [None req-7361a831-b8ab-4942-9e73-0ce0173d5bc8 admin admin] The token cache is being invalidate because project 3b7f1342961b4dba998564d8c1f94354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 04:12:28.431726 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [None req-7361a831-b8ab-4942-9e73-0ce0173d5bc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:12:28.432352 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG keystone.notifications [None req-7361a831-b8ab-4942-9e73-0ce0173d5bc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 04:12:28.433850 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: [pid: 88197|app: 0|req: 643/1261] 10.222.0.43 () {58 vars in 1233 bytes} [Fri Aug 19 04:12:28 2022] DELETE /identity/v3/projects/3b7f1342961b4dba998564d8c1f94354 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 04:12:38.102830 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=55 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:12:38.428073 dv-osbrick-786733-7-ceph devstack@keystone.service[88197]: DEBUG dbcounter [-] [88197] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 04:15:55.252197 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00102b-8d53-421d-a49e-b4fc051775ec admin admin] Authenticating user token {{(pid=88198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 04:15:55.253619 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-dc00102b-8d53-421d-a49e-b4fc051775ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:15:55.329126 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00102b-8d53-421d-a49e-b4fc051775ec admin admin] Validating token access rules against request {{(pid=88198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 04:15:55.386799 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38655e8d-172b-42aa-aab7-e7699f0e8121 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '366baacae7c143929a64f5b639c17a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b09192159c884e73bef832a38e2d5e7c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 04:15:55.387404 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38655e8d-172b-42aa-aab7-e7699f0e8121 service placement] REQUEST_METHOD: `GET` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 04:15:55.387681 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38655e8d-172b-42aa-aab7-e7699f0e8121 service placement] SCRIPT_NAME: `/identity` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 04:15:55.387954 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38655e8d-172b-42aa-aab7-e7699f0e8121 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 04:15:55.389672 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.fernet_utils [None req-38655e8d-172b-42aa-aab7-e7699f0e8121 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 04:15:55.400263 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38655e8d-172b-42aa-aab7-e7699f0e8121 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 04:15:55.401880 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38655e8d-172b-42aa-aab7-e7699f0e8121 service placement] RBAC: Authorization granted {{(pid=88198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 04:15:55.411238 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: [pid: 88198|app: 0|req: 619/1262] 10.222.0.43 () {60 vars in 1365 bytes} [Fri Aug 19 04:15:55 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 04:16:05.407360 dv-osbrick-786733-7-ceph devstack@keystone.service[88198]: DEBUG dbcounter [-] [88198] Writing DB stats keystone:SELECT=62 {{(pid=88198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}